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Summary. We consider two basic types of coarse-graining; the Ehrenfests' coarse- 
graining and its extension to a general principle of non-equilibrium thermodynamics, 
and the coarse-graining based on uncertainty of dynamical models and e-motions 
(orbits). Non-technical discussion of basic notions and main coarse-graining theo- 
rems are presented: the theorem about entropy overproduction for the Ehrenfests' 
coarse-graining and its generalizations, both for conservative and for dissipative sys- 
tems, and the theorems about stable properties and the Smale order for e-motions of 
general dynamical systems including structurally unstable systems. Computational 
kinetic models of macroscopic dynamics are considered. We construct a theoreti- 
cal basis for these kinetic models using generalizations of the Ehrenfests' coarse- 
graining. General theory of reversible regularization and filtering semigroups in ki- 
netics is presented, both for linear and non-linear filters. We obtain explicit expres- 
sions and entropic stability conditions for filtered equations. A brief discussion of 
coarse-graining by rounding and by small noise is also presented. 



1 Introduction 

Almost a century ago, Paul and Tanya Ehrenfest in their paper for scientific 
Encyclopedia [1] introduced a special operation, the coarse-graining. This op- 
eration transforms a probability density in phase space into a "coarse-grained" 
density, that is a piece- wise constant function, a result of density averaging in 
cells. The size of cells is assumed to be small, but finite, and does not tend to 
zero. The coarse-graining models uncontrollable impact of surrounding (of a 
thermostat, for example) onto ensemble of mechanical systems. 

To understand reasons for introduction of this new notion, let us take a 
phase drop, that is, an ensemble of mechanical systems with constant probabil- 
ity density localized in a small domain of phase space. Let us watch evolution 
of this drop in time according to the Liouville equation. After a long time, 
the shape of the drop may be very complicated, but the density value remains 
the same, and this drop remains "oil in water." The ensemble can tend to the 
equilibrium in the weak sense only: average value of any continuous function 
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Fig. 1. The Ehrenfests' coarse-graining: two "motion - coarse-graining" cycles in 
ID (a, values of probability density are presented by the height of the columns) 
and one such cycle in 2D (b, values of probability density are presented by hatching 
density) . 



tends to its equilibrium value, but the entropy of the distribution remains 
constant. Nevertheless, if we divide the phase space into cells and supplement 
the mechanical motion by the periodical averaging in cells (this is the Ehren- 
fests' idea of coarse- graining), then the entropy increases, and the distribution 
density tends uniformly to the equilibrium. This periodical coarse-graining is 
illustrated by Fig. ^ for one-dimensional (ID)^ and two-dimensional (2D) 
phase spaces. 

Recently, we can find the idea of coarse-graining everywhere in statisti- 
cal physics (both equilibrium and non-equilibrium). For example, it is the 
central idea of the Kadanoff transformation, and can be considered as a back- 

^ Of course, there is no mechanical system with one-dimensional phase space, but 
dynamics with conservation of volume is possible in ID case too: it is a motion 
with constant velocity. 
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ground of the Wilson renormalization group [6] and modern renormalisation 
group approach to dissipativc systems [7,8]. ^ It gave a simplest realization 
of the projection operators technique [2] long before this technic was devel- 
oped. In the method of invariant manifold [3, 4] the generalized Ehrenfests' 
coarse-graining allows to find slow dynamics without a slow manifold con- 
struction. It is also present in the background of the so-called equation-free 
methods [9]. Applications of the Ehrenfests' coarse-graining outside statisti- 
cal physics include simple, but effective filtering [10]. The Gaussian filtering 
of hydrodynamic equations that leads to the Smagorinsky equations [14] is, 
in its essence, again a version of the Ehrenfests' coarse-graining. In the first 
part of this paper we elaborate in details the Ehrenfests' coarse-graining for 
dynamical systems. 

The central idea of the Ehrenfests' coarse-graining remains the same in 
most generalizations: wc combine the genuine motion with the periodic par- 
tial equlibration. The result is the Ehrenfests' chain. After that, we can find 
the macroscopic equation that does not depend on an initial distribution 
and describes the Ehrenfests' chains as results of continuous autonomous 
motion [5, 11]. Alternatively, we can just create a computational procedure 
without explicit equations [9] . In the sense of entropy production, the result- 
ing macroscopic motion is "more dissipative" than initial (microscopic) one. 
It is the theorem about entropy overproduction. In its general form it was 
proven in [12]. 

Kinetic models of fluid dynamics become very popular during the last 
decade. Usual way of model simplification leads from kinetics to fluid dynam- 
ics, it is a sort of dimension reduction. But kinetic models go back, and it is the 
simplification also. Some of kinetic equations arc very simple and even exactly 
solvable. The simplest and most popular example is the free flight kinetics, 
df{x, V, t)/dt = — Vidf{x, V, t)/dxi, where f{x, v, t) is one-particle distri- 
bution function, x is space vector, v is velocity. Wc can "lift" a continuum 
equation to a kinetic model, and than approximate the solution by a chain, 
each link of which is a kinetic curve with a jump from the end of this curve 
to the beginning of the next link. In this paper, wc describe how to construct 
these curves, chains, links and jumps on the base of Ehrenfests' idea. Kinetic 
model has more variables than continuum equation. Sometimes simplification 
in modeling can be reached by dimension increase, and it is not a miracle. 

In practice, kinetic models in the form of lattice Boltzmann models are in 
use [19]. The Ehrenfests' coarse-graining provides theoretical basis for kinetic 
models. First of all, it is possible to replace projecting (partial equilibration) 
by involution (i.e. reflection with respect to the partial equilibrium). This 
entropic involution was developed for the lattice Boltzmann methods in [89]. 
In the original Ehrenfests' chains, "motion partial equilibration-motion 
dissipation is coupled with time step, but the chains "motion involution- 

^ See also tlie paper of A. Degenhard and J. Javier Rodriguez-Laguna in this vol- 
ume. 
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motion-..." are conservative. The family of chains between conservative (with 
entropic involution) and maximally dissipativc (with projection) ones give us a 
possibility to model hydrodynamic systems with various dissipation (viscosity) 
coefficients that are decoupled with time steps. 

Large eddy simulation, filtering and subgrid modeling arc very popular in 
fluid dynamics [13-17]. The idea is that small inhomogeneities should somehow 
equilibrate, and their statistics should follow the large scale details of the flow. 
Our goal is to restore a link between this approach and initial coarse-raining 
in statistical physics. Physically, this type of coarse-graining is transference 
the energy of small scale motion from macroscopic kinetic energy to micro- 
scopic internal energy. The natural framework for analysis of such transference 
provides physical kinetics, where initially exists no difference between kinetic 
and internal energy. This difference appears in the continuum mechanic limit. 
We proposed this idea several years ago, and an example for moment equa- 
tions was published in [18]. Now the kinetic approach for filtering is presented. 
The general commutator expansion for all kind of linear or non-linear filters, 
with constant or with variable coefficients is constructed. The condition for 
stability of filtered equation is obtained. 

The upper boundary for the filter width A that guaranties stability of the 
filtered equations is proportional to the square root of the Knudsen number. 
A/L ^ \/Kn (where L is the characteristic macroscopic length). This scaling, 
AjL ~ \/Kn^ was discussed in [18] for moment kinetic equations because 
different reasons: if AjL 3> V Kn then the Chapman Enskog procedure for 
the way back from kinetics to continuum is not applicable, and, moreover, 
the continuum description is probably not valid, because the filtering term 
with large coefficient AjL violates the conditions of hydrodynamic limit. This 
important remark gives the frame for t] scaling. It is proven in this paper for 
the broad class of model kinetic equations. The entropic stability conditions 
presented below give the stability boundaries inside this scale. 

Several other notions of coarse-graining were introduced and studied for 
dynamical systems during last hundred years. In this paper, we shall consider 
one of them, the coarse-graining by e-motions (e-orbits, or pscudo orbits) and 
briefly mention two other types: coarse-graining by rounding and by small 
random noise. 

e-motions describe dynamics of models with uncertainty. We never know 
our models exactly, we never deal with isolated systems, and the surrounding 
always uncontrollably affect dynamics of the system. This dynamics can be 
presented as a usual phase flow supplemented by a periodical e-fattening: after 
time r, we add a e-ball to each point, hence, points are transformed into sets. 
This periodical fattening expands all attractors: for the system with fattening 
they are larger than for original dynamics. 

Interest to the dynamics of e-motions was stimulated by the famous work 
of S. Smale [20]. This paper destroyed many naive dreams and expectations. 
For generic 2D system the phase portrait is the structure of attractors (sinks), 
repellers (sources), and saddles. For generic 2D systems all these attractors 
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are either fixed point or closed orbits. Generic 2D systems are structurally 
stable. It means that they do not change qualitatively after small perturba- 
tions. Our dream was to find a similar stable structure in generic systems for 
higher dimensions, but S. Smale showed it is impossible: Structurally stable 
systems are not dense! Unfortunately, in higher dimensions there are regions 
of dynamical systems that can change qualitatively under arbitrary small per- 
turbations. 

One of the reasons to study e-motions (flow with fattening) and systems 
with sustained perturbations was the hope that even small errors coarsen the 
picture and can wipe some of the thin peculiarities off. And this hope was 
realistic, at least, partially [21-23]. The thin pecuharities that are responsible 
for appearance of regions of structurally unstable systems vanish after the 
coarse-graining via arbitrary small periodical fattening. All the models have 
some uncertainty, hence, the features of dynamics that are unstable under 
arbitrary small coarse-graining are unobservable. 

Rounding is a sort of coarse-graining that appears automatically in com- 
puter simulations. It is very natural that in era of intensive computer sim- 
ulation of complex dynamics the coarse-graining by rounding attracted spe- 
cial attention [24-30] . According to a very idealized popular dynamic model, 
rounding might be represented as restriction of shift in given time t onto e- 
net in phase space. Of courses, the restriction includes some perturbation of 
dynamics (Fig. . The formal definition of rounding action includes a tiling: 
around any point of the £-net there is a cell, these cells form a tiling of the 
phase space, and rounding maps a cell into corresponding point of the e-net. 
These cells have equal volumes if there are no special reasons to make their 
volumes different. If this volume is dynamically invariant then, for sufficiently 
large time of motion between rounding steps, all the mixing dynamical sys- 
tems with rounding can be described by an universal object. This is a random 
dynamical system, the random map of a finite set: any point of the e-net can 
be the image of a given point with probability 1/m (where m is the number 
of points in the e-net). The combinatorial theory of such random graphs is 
well-developed [31]. 

After rounding, some unexpected properties of dynamics appear. For ex- 
ample, even for transitive systems with strong mixing significant part of points 
of the £-net becomes transient after rounding. Initially, attractor of such a 
continuous system is the whole phase space, but after rounding attractor of 
discrete dynamical system on the e-net includes, roughly speaking, a half of its 
points (or, more precisely, the expectation of the number of transient points is 
m(e — l)/e, where m is number of points, e = 2.7...). In some circumstances, 
complicated dynamics has a tendency to collapse to trivial and degenerate 
behaviour as a result of discretizations [27]. For systems without conserva- 
tion of volume, the number of periodic points after discretization is linked to 
the dimension of the attractor d. The simple estimates based on the random 
map analysis, and numerical experiments with chaotic attractors give ^ e~'^ 
for the number of periodic points, and ~ e^''/^ for the scale of the expected 
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Fig. 2. Motion, rounding and "motion witli rounding" for a dynamical system (a), 
and the universal result of motion with rounding: a random dynamical system (b). 



period [26,30]. The first of them is just the number of points in e-net in d- 
dimensional compact, the second becomes clear after the following remark. 
Let us imagine a random walk in a finite set with m elements (a e-net). When 
the length of the trajectory is of order ^Jrri then the next step returns the 
point to the trajectory with probability ~ l/^/m, and a loop appears with 
expected period ~ s/m (a half of the trajectory length). After ~ ^Jm steps 
the probability of a loop appearance is near 1, hence, for the whole system 
the expected period is ~ ^/m ~ e~'^l'^ . 

It is easy to demonstrate the difference between coarse-graining by fat- 
tening and coarse-graining by rounding. Let us consider a trivial dynamics 
on a connected phase space: let the shift in time be identical transformation. 
For coarse-graining by fattening the e-motion of any point tends to cover the 
whole phase space for any positive e and time i ^ oo: periodical e-fattening 
with trivial dynamics transforms, after time nr, a point into the sum of n e- 
balls. For coarse-graining by rounding this trivial dynamical system generates 
the same trivial dynamical system on e-net: nothing moves. 

Coarse-graining by small noise seems to be very natural. We add small 
random term to the right hand side of differential equations that describe 
dynamics. Instead of the Liouville equation for probability density the Fokker- 
Planck equation appears. There is no fundamental difference between various 
types of coarse-graining, and the coarse-graining by e-fattening includes major 
results about the coarse-graining by small noise that are insensitive to most 
details of noise distribution. But the knowledge of noise distribution gives 
us additional tools. The action functional is such a tool for the description 
of fluctuations [32]. Let X^{t) be a random process "dynamics with e-small 
fluctuation" on the time interval [0, T]. It is possible to introduce such a 
functional S[ip] on functions x = (p{t) (t G [0,T]) that for sufficiently small 
e,(5 > 

P{||X^-(^|| <5}«cxp(-S[vp]/e2). 
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Action functional is constructed for various types of random perturbations 
[32]. Introduction to the general theory of random dynamical systems with 
invariant measure is presented in [33]. 

In following sections, we consider two types of coarse-graining: the Ehren- 
fests' coarse-graining and its extension to a general principle of non-equilibrium 
thermodynamics, and the coarse-graining based on the uncertainty of dynam- 
ical models and e-motions. 



2 The Ehrenfests' Coarse-graining 
2.1 Kinetic equation and entropy 

Entropy conservation in systems with conservation of phase volume 

The Erenfest's coarse-graining was originally defined for conservative^ sys- 
tems. Usually, Hamiltonian systems are considered as conservative ones, but 
in all constructions only one property of Hamiltonian systems is used, namely, 
conservation of the phase volume dF (the Liouville theorem). Let X be phase 
space, v{x) be a vector field, dF = d^x be the differential of phase volume. 
The flow, 

^f = .W, (1) 

conserves the phase volume, if divv{x) = 0. The continuity equation, 

dt dxi ' ^ ' 

describes the induced dynamics of the probability density f{x, t) on phase 
space. For incompressible flow (conservation of volume), the continuity equa- 
tion can be rewritten in the form 

This means that the probability density is constant along the flow: f{x,t + 
dt) = f{x — v{x)dt,t). Hence, for any continuous function h{f) the integral 

H{f)= f h{f{x))dr{x) (4) 

^ In this paper, we use the term "conservative" as an opposite term to "dissipative:" 
conservative = with entropy conservation. Another use of the term "conservative 
system" is connected with energy conservation. For kinetic systems under con- 
sideration conservation of energy is a simple linear balance, and we shall use the 
first sense only. 
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does not change in time, provided the probabiHty density satisfies the con- 
tinuity equation |(2Jl and the flow v{x) conserves the phase volume. For 
h{f) — —/In/ integral Q gives the classical Boltzmann-Gibbs-Shannon 
(BGS) entropy functional: 

S{f) = - f f{x)Hf{x))drix). (5) 

Jx 

For flows with conservation of volume, entropy is conserved: dS/dt = . 

Kullback entropy conservation in systems with regular invariant distribution 

Suppose the phase volume is not invariant with respect to flow but a 
regular invariant density f*{x) (equilibrium) exists: 

^djnxM^^^_ (6) 

OXi 

t 

In this case, instead of an invariant phase volume dF, we have an invariant 
volume f*{x)dr. We can use © instead of the incompressibility condition 
and rewrite Q: 

d{f{x,t)/r{x)) ^ ^ , ^ dif{x,t)/r{x)) 

dt ~ dx^ ■ 

The function /(x, t) //* {x) is constant along the flow, the measure /* {x) dr{x) 
is invariant, hence, for any continuous function h{f) integral 

H{f)^ I h{j{x,t)/r{x))r{x)dr{x) (8) 



does not change in time, if the probability density satisfies the continuity 
equation. For h{f) = — / In / integral ^ gives the Kullback entropy functional 
[42]: 

Sxif) = -J^ fix) In (^-M.^ dr{x). (9) 

This situation does not differ significantly from the entropy conservation in 
systems with conservation of volume. It is just a kind of change of variables. 

General entropy production formula 

Let us consider the general case without assumptions about phase volume 
invariance and existence of a regular invariant density ®. In this case, let a 
probability density f{x,t) be a solution of the continuity equation For 
the BGS entropy functional (0 

/ /(x,t)div^,(x)dr(x), (10) 



X 
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if the left hand side exists. This entropy production formula can be easily 
proven for small phase drops with constant density, and then for finite sums 
of such distributions with positive coefficients. After that, we obtain formula 
H1U|I by limit transition. 

For a regular invariant density f*{x) (equilibrium) entropy S{f*) exists, 
and for this distribution dS{f)/dt = 0, hence. 



Entropy production in systems without regular equilibrium 

If there is no regular equilibrium ((HJ, then the entropy behaviour changes 
drastically. If volume of phase drops tends to zero, then the BGS entropy Q 
and any KuUback entropy lO goes to minus infinity. The simplest example 
clarifies the situation. Let all the solutions converge to unique exponentially 
stable fixed point x — 0. In linear approximation dx/dt = Ax and S(t) ~ 
5(0) + tti'A. Entropy decreases linearly in time with the rate trA {trA — 
divw(x), tvA < 0), time derivative of entropy is trA and does not change in 
time, and the probability distribution goes to the (5-function S{x). Entropy of 
this distribution does not exist (it is "minus infinity"), and it has no limit 
when f{x,t) 5{x). 

Nevertheless, time derivative of entropy is well defined and constant, it is 
tiA. For more complicated singular limit distributions the essence remains the 
same: according to time derivative of entropy tends to the average value 
of divv{x) in this limit distribution, and entropy goes linearly to minus infinity 
(if this average in not zero, of course). The order in the system increases. This 
behaviour could sometimes be interpreted as follows: the system is open and 
produces entropy in its surrounding even in a steady-state. Much more details 
are in review [41].^ 

Starting point: a kinetic equation 

For the formalization of the Ehrenfests' idea of coarse-graining, we start from 
a formal kinetic equation 



with a concave entropy functional S{f) that does not increase in time. This 
equation is defined in a convex subset [/ of a vector space E. 

* Applications of this formalism are mainly related to Hamiltonian systems in so- 
called force thermostat, or, in particular, isokinetic thermostat. These thermostats 
were invented in computational molecular dynamics for acceleration of compu- 
tations, as a technical trick. From the physical point of view, this theory can be 
considered as a theory about a friction of particles on the space, the "ether fric- 
tion." For isokinetic thermostats, for example, this "friction" decelerates some of 
particles, accelerates others, and keeps the kinetic energy constant. 




(11) 




(12) 
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Let us specify some notations: E'^ is the adjoint to the E space. Adjoint 
spaces and operators wih be indicated by , whereas the notation * is ear- 
marked for equihbria and quasi-equihbria. 

We recall that, for an operator A : Ei ^ E2, the adjoint operator, : 
Ef E2 is defined by the following relation: for any I e _Ej and (p £ Ei, 
liA^) = (A^im. 

Next, DfSif) e E'^ is the differential of the functional S{f), D)S{f) 
is the second differential of the functional S{f). The quadratic functional 
D'jS{f){(p, (fi) on E is defined by the Taylor formula, 

S{f + ^) = Sif) + DfS{f){ip) + lDpif)i^, ^) + o{\\pf). (13) 

We keep the same notation for the corresponding symmetric bilinear form, 
D'jS{f){(p, t/i), and also for the Hnear operator, Dp{f) : E — > £'^, defined by 
the formula {D'jS{f)ip){ip) — DjS{f){ip,ilj)- In this formula, on the left hand 
side Dp{f) is the operator, on the right hand side it is the bilinear form. 
Operator DjS{f) is symmetric on E, Dp{ff = D)S{f). 

In finite dimensions the functional DfS{f) can be presented simply as a 
row vector of partial derivatives of S, and the operator D'jS{f) is a matrix 
of second partial derivatives. For infinite-dimensional spaces some complica- 
tions exist because S{f) is defined only for classical densities and not for all 
distributions. In this paper we do not pay attention to these details. 

We assume strict concavity of S, D'jS{f){(p, (p) < if 7^ 0. This means 
that for any / the positive definite quadratic form —D'jS{f){Lp,ip) defines a 
scalar product 

{ip,^P)f = -{D}S)iip,^j). (14) 

This entropic scalar product is an important part of thermodynamic formal- 
ism. For the BGS entropy jSJ as well as for the KuUback entropy (jSJ 

{V.i^)f^j ^(^^ dx. (15) 

The most important assumption about kinetic equation H12|l is: entropy 
does not decrease in time: 

^ = {DfS{mJ{f)) > 0. (16) 

A particular case of this assumption is: the system H12|) is conservative and 
entropy is constant. The main example of such conservative equations is the 
Liouville equation with linear vector field J(/) — ~Lf = {H, /}, where {H, /} 
is the Poisson bracket with Hamiltonian H. 

For the following consideration of the Ehrenfests' coarse-graining the un- 
derlying mechanical motion is not crucial, and it is possible to start from the 
formal kinetic equation H12|l without any mechanical interpretation of vec- 
tors /. We develop below the coarse- graining procedure for general kinetic 
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equation (|12|l with non-decreasing entropy (|16|) . After coarse-graining the en- 
tropy production increases: conservative systems become dissipative ones, and 
dissipative systems become "more dissipative." 

2.2 Conditional equilibrium instead of averaging in cells 

Microdescription, macrodescription and quasi- equilibrium state 

Averaging in ceUs is a particular case of entropy maximization. Let the phase 
space be divided into cells. For the ith cell the population Mi is 

M, = m,{f)^ f f{x)dr{x). 

The averaging in cells for a given vector of populations M — (Mi) produces 
the solution of the optimization problem for the BGS entropy: 

S{f) ^ max, m(/) = M, (17) 

where m{f) is vector {■mi{f)). The maximizer is a function ,f%i{x) defined by 
the vector of averages M . 

This operation has a well-known generalization. In the more general state- 
ment, vector / is a microscopic description of the system, vector M gives a 
macroscopic description, and a linear operator m transforms a microscopic 
description into a macroscopic one: M = m{f). The standard example is 
the transformation of the microscopic density into the hydrodynamic fields 
(density-velocity-kinetic temperature) with local Maxwellian distributions as 
entropy maximizers (see, for example, [4]). 

For any macroscopic description M, let us define the correspondent f^j as a 
solution to optimization problem Ijl?!) with an appropriate entropy functional 
S{f) (Fig. O. This fij has many names in the literature: MaxEnt distribu- 
tion, reference distribution (reference of the macroscopic description to the 
microscopic one), generalized canonical ensemble, conditional equilibrium, or 
quasi- equilibrium. We shall use here the last term. 

The quasi-equilibrium distribution f^.j satisfies the obvious, but important 
identity of self-consistency: 

mifli) - M, (18) 

or in differential form 

m(i?A//M) = 1, i.e. m((DM/X/)a) = a. (19) 

The last identity means that the infinitesimal change in M calculated through 
differential of the quasi-equilibrium distribution f^j is simply the infinitesimal 
change in M . For the second differential we obtain 



"^(^m/m) = 0, i.e. m{{DlJl,){a,b)) = 0. 



(20) 
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Fig. 3. Relations between a microscopic state /, a corresponding macroscopic state 
M = m{f), and a quasi-equilibrium state /m- 

Following [4] let us mention that most of the works on nonequilibrium 
thermodynamics deal with quasi-equilibrium approximations and corrections 

to them, or with applications of these approximations (with or without correc- 
tions). This viewpoint is not the only possible but it proves very efficient for 
the construction of a variety of useful models, approximations and equations, 
as well as methods to solve them. 

From time to time it is discussed in the literature, who was the first to in- 
troduce the quasi-equilibrium approximations, and how to interpret them. At 
least a part of the discussion is due to a different role the quasi-equilibrium 
plays in the entropy-conserving and in the dissipative dynamics. The very 
first use of the entropy maximization dates back to the classical work of G. 
W. Gibbs [47], but it was first claimed for a principle of informational sta- 
tistical thermodynamics by E. T. Jaynes [48]. Probably, the first explicit and 
systematic use of quasiequilibria on the way from entropy-conserving dynam- 
ics to dissipative kinetics was imdertaken by D. N. Zubarev. Recent detailed 
exposition of his approach is given in [49] . 

For dissipative systems, the use of the quasi-equilibrium to reduce descrip- 
tion can be traced to the works of H. Grad on the Boltzmann equation [50]. A 
review of the informational statistical thermodynamics was presented in [51]. 
The connection between entropy maximization and (nonlinear) Onsager rela- 
tions was also studied [52,53]. Our viewpoint was influenced by the papers 
by L. I. Rozonoer and co-workers, in particular, [54-56]. A detailed exposi- 
tion of the quasi-equilibrium approximation for Markov chains is given in the 
book [34] (Chap. 3, Quasi-equilibrium and entropy maximum, pp. 92-122), 
and for the BBGKY hierarchy in the paper [57]. 



Basic Types of Coarse- Graining 



13 



The maximum entropy principle was applied to the description of the 
universal dependence of the three-particle distribution function F3 on the two- 
particle distribution function F2 in classical systems with binary interactions 
[58]. For a discussion of the quasi-equilibrium moment closure hierarchies for 
the Boltzmann equation [55] see the papers [59-61]. A very general discussion 
of the maximum entropy principle with applications to dissipative kinetics is 
given in the review [62]. Recently, the quasi-equilibrium approximation with 
some further correction was applied to the description of rheology of polymer 
solutions [64,65] and of ferrofluids [66,67]. Quasi-equilibrium approximations 
for quantum systems in the Wigner representation [70,71] was discussed very 
recently [63]. 

We shall now introduce the quasi-equilibrium approximation in the most 
general setting. The coarse-graining procedure will be developed after that as 
a method for enhancement of the quasi-equilibrium approximation [5]. 

Quasi-equilibrium manifold, projector and approximation 

A quasi-equilibrium manifold is a set of quasi-equilibrium states f^j parame- 
terized by macroscopic variables M. For microscopic states / the correspon- 
dent quasi-equilibrium states are defined as f^(^fy Relations between /, M, 
fli, and fm{f) presented in Fig.|3| 

A quasi-equilibrium approximation for the kinetic equation H12|l is an equa- 
tion for M{t): 

^=rniJifl,)). (21) 

To define M in the quasi-equilibrium approximation for given M, we find the 
correspondent quasi-equilibrium state flj and the time derivative of / in this 
state J{fM)j then return to the macroscopic variables by the operator m. 
If M(t) satisfies (|21ll then /^/(j) satisfies the following equation 

^ - (DMni) (^) - {DMf*M)im{J{fl,))). (22) 

The right hand side of (|22|l is the projection of vector field J{f) onto the 
tangent space of the quasi-equilibrium manifold at the point / ~ f^j . After 
calculating the differential DMfti from the definition of quasi-equilibrium 
P7(l . we obtain d/j^j/dt = fliJiflii)! where tt^*^ is the quasi-equilibrium 
projector. 

TTf;, = (DMfli) m = {DjS)-!^^ (m {d}S)~1 m^) m. (23) 

It is straightforward to check the equality tt^, = 7r/»^ , and the self-adjointness 
of TT/*^ with respect to entropic scalar product In this scalar product, 

the quasi-equilibrium projector is the orthogonal projector onto the tangent 
space to the quasi-equilibrium manifold. The quasi-equilibrium projector for 
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M 




Fig. 4. Quasi-equilibrium manifold S7, tangent space Tf*^ Q, quasi-equilibrium pro- 
jector 71" and defect of invariance, ^/'j = J ~ irf'^iJ). 



a quasi-equilibrium approximation was first constructed by B. Robertson [68]. 

Thus, we have introduced the basic constructions: quasi-equilibrium man- 
ifold, entropic scalar product, and quasi-equiUbrium projector (Fig.^. 

Preservation of dissipation 

For the quasi-equilibrium approximation the entropy is S{M) = S{flj). For 
this entropy, 



Here, on the left hand side stands the macroscopic entropy production for the 
quasi-equilibrium approximation H21(l . and the right hand side is the micro- 
scopic entropy production calculated for the initial kinetic equation 112|l . This 
equality implies preservation of the type of dynamics [34,35]: 

• If for the initial kinetics H12(l the dissipativity inequality H16(l holds then 
the same inequality is true for the quasi-equilibrium approximation (|21|l : 

• If the initial kinetics (|12|) is conservative then the quasi-equilibrium ap- 
proximation H21|l is conservative also. 

For example, let the initial kinetic equation be the Liouville equation for a 
system of many identical particles with binary interaction. If we choose as 
macroscopic variables the one-particle distribution function, then the quasi- 
equilibrium approximation is the Vlasov equation. If we choose as macroscopic 
variables the hydrodynamic fields, then the quasi-equilibrium approximation 
is the compressible Euler equation with self-interaction of liquid. Both of these 
equations are conservative and turn out to be even Hamiltonian systems [69] . 




(24) 
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Measurement of accuracy 

Accuracy of the quasi-equilibrium approximation near a given M can be mea- 
sured by the defect of invariance (Fig.Q: 



A dimensionless criterion of accuracy is the ratio ||Zi/*^ ||/|| J(/^^)|| (a "sine" 
of the angle between J and tangent space). If Af-*^ =0 then the quasi- 
equihbrium manifold is an invariant manifold, and the quasi-equilibrium ap- 
proximation is exact. In applications, the quasi-equilibrium approximation is 
usually not exact. 

The Gibbs entropy and the Boltzmann entropy 

For analysis of micro-macro relations some authors [77, 78] call entropy S{f) 
the Gibbs entropy, and introduce a notion of the Boltzmann entropy. Boltz- 
mann defined the entropy of a macroscopic system in a macrostate M as the 
log of the volume of phase space (number of microstates) corresponding to 
M. In the proposed level of generality [34,35], the Boltzmann entropy of the 
state / can be defined as 5*6 (/) = '^{fm{f)')- entropy of the projection of / 
onto quasi-equilibrium manifold (the "shadow" entropy). For conservative sys- 
tems the Gibbs entropy is constant, but the Boltzmann entropy increases [35] 
(during some time, at least) for motions that start on the quasi-equilibrium 
manifold, but not belong to this manifold. 

These notions of the Gibbs or Boltzmann entropy are related to micro- 
macro transition and may be applied to any convex entropy functional, not 
the BGS entropy (O only. This may cause some terminological problems (we 
hope, not here), and it may be better just to call 'S'(/m(/)) the macroscopic 
entropy. 

Invariance equation and the Chapman-Enskog expansion 

The first method for improvement of the quasi-equilibrium approximation 
was the Chapman-Enskog method for the Boltzmann equation [79]. It uses 
the explicit structure of singularly perturbed systems. Many other methods 
were invented later, and not all of them use this explicit structure (see, for 
example review in [4]). Here we develop the Chapman-Enskog method for 
one important class of model equations that were invented to substitute the 
Boltzmann equation and other more complicated systems when we don't know 
the details of microscopic kinetics. It includes the well-known Bhatnagar- 
Gross-Krook (BGK) kinetic equation [38] , as well as wide class of generalized 
model equations [39]. 

As a starting point we take a formal kinetic equation with a small param- 
eter e 



(25) 



df 



^(.f) = J^(/) + -(/„(/)-/). 



(26) 



dt 
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The term (/^(j) — /) is non-linear because nonlinear dependency fm{f) 
m{f). 

We would like to find a reduced description valid for macroscopic vari- 
ables M. It means, at least, that we are looking for an invariant manifold 
parameterized by M, / — /m, that satisfies the invariance equation: 

iDMfM)imiJ{fM))) = J(/m). (27) 

The invariance equation means that the time derivative of / calculated 
through the time derivative of M (M = m{J {f m))) by the chain rule co- 
incides with the true time derivative J(/). This is the central equation for the 
model reduction theory and applications. First general results about existence 
and regularity of solutions to that equation were obtained by Lyapunov [83] 
(see review in [3,4]). For kinetic equation H26|l the invariance equation has a 
form 

{DMfM){m{F{fM))) - F(/m) + hflt - Im), (28) 

because the self-consistency identity ((T^ . 

Due to presence of small parameter e in J(/), the zero approximation is 
obviously the quasi-equilibrium approximation: = f^j. Let us look for /m 

in the form of power series: /a/ — /|°^ + ef[]^ + . . .; 'm{fl^j^) = for fc > 1. 
From H28|l we immediately find: 

fi]^ = FiC) - (i?M/f;)(m(i^(/l?))) = Zi/.,. (29) 

It is very natural that the first term of the Chapman-Enskog expansion for 
model equations H26|l is just the defect of invariance for the quasi-equilibrium 
approximation. Calculation of the following terms is also straightforward. 

The correspondent first-order in e approximation for the macroscopic 
equations is: 

^ = m(F(/X,)) + emiiDfF{f))f.Af.J. (30) 

We should remind that m{Af ) = 0. The last term in H28|l vanishes in macro- 
scopic projection for all orders. 

The typical situation for the model equations H26() is: the vector field F{f ) 
is conservative, (D fS{f))F{f) = 0. In that case, the first term m{F{f'^,j)) also 
conserves the correspondent Boltzniann (i.e. macroscopic, but not obligatory 
BGS) entropy S'(/^^). But the straightforward calculation of the Boltzmann 
entropy S{f^j) production for the first-order Chapman-Enskog term in equa- 
tion (|30|l gives us for conservative F{f): 

^^ = e{Ar,Ar)r > o. (3i) 

where (•,•)/ is the entropic scalar product (|14|1 . The Boltzmann entropy 
production in the first Chapman-Enskog approximation is zero if and only if 
Af2^ = 0, i.e. if at point M the quasi-equilibrium manifold is locally invariant. 
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To prove (|31|l we differentiate the conservativity identity: 

{DfS{f))F{f) EE (32) 
{DjS{F))(F{f),a) + {DfS{f)){{DfF{f))a) ee 
{DfS{fmDfFif))a)^{F{f),a)f, 

use the last equahty in the expression of the entropy production, and take 
into account that the quasi-equiHbrium projector is orthogonal, hence 

Below we apply the Chapman-Enskog method to the analysis of filtered 
BGK equation. 



2.3 The Ehrenfests' Chain, Macroscopic Equations and Entropy 
production 

The Ehrenfests ' Chain and entropy growth 

Let 0t be the time shift transformation for the initial kinetic equation H12|) : 

0tifm = fit). 

The Ehrenfests' chain (Fig. [SI is defined for a given macroscopic variables 
M = m{f) and a fixed time of coarse-graining r. It is a chain of quasi- 
equilibrium states /o, /i, . . .: 

(33) 



18 Alexander N. Gorban 



To get the next point of the chain, /i+i, we take fi, move it by the time shift 
0r, calculate the corresponding macroscopic state Af^+i — m{Or{fi)), and 
find the quasi-equilibrium state /^i+i = fi+i- 

If the point Orifi) is not a quasi-equilibrium state, then S{0T{fi)) < 
^(fm{0 (/ ))) because of quasi-equilibrium definition (|17|l and strict concavity 
of entropy. Hence, if the motion between fi and Orifi) does not belong to 
the quasi-equilibrium manifold, then > S{fi), entropy in the Ehren- 

fests' chain grows. The entropy gain consists of two parts: the gain in the 
motion (from fi to Orifi)), and the gain in the projection (from Orifi) to 
/i+i = f*n(0 (/ )))■ -Both parts are non-negative. For conservative systems the 
first part is zero. The second part is strictly positive if the motion leaves 
the quasi-equilibrium manifold. Hence, we observe some sort of duality be- 
tween entropy production in the Ehrenfests' chain and invariance of the quasi- 
equilibrium manifold. The motions that build the Ehrenfests' chain restart pe- 
riodically from the quasi-equilibrium manifold and the entropy growth along 
this chain is similar to the Boltzmann entropy growth in the Chapman-Enskog 
approximation, and that similarity is very deep, as the exact formulas show 
below. 

The natural projector and macroscopic dynamics 

How to use the Ehrenfests' chains? First of all, we can try to define the macro- 
scopic kinetic equations for M(t) by the requirement that for any initial point 
of the chain /o the solution of these macroscopic equations with initial con- 
ditions A/(0) — m(/o) goes through all the points mifi): M(nT) = m(/„) 
(n = 1,2,...) (Fig. O [5] (see also [4]). Another way is an "equation-free 
approach" [9] to the direct computation of the Ehrenfests' chain with a com- 
bination of microscopic simulation and macroscopic stepping. 

For the definition of the macroscopic equations only the first link of the 
Ehrenfests' chain is necessary. In general form, for an ansatz manifold J7, pro- 
jector TT : [/ ^ ]7 of the vicinity of fl onto ]7, phase flow of the initial kinetic 
equation Ot, and macroscopic phase flow Ot on Q the matching condition is 
(Fig.®: 

^(e.(/)) = e.(/)forany/e/?. (34) 

We call this projector of the flow O onto an ansatz manifold fi by fragments 
of trajectories of given duration r the natural projector in order to distinguish 
it from the standard inflnitesimal projector of vector flclds on tangent spaces. 
Let us look for the macroscopic equations of the form 

(35) 

with the phase flow <!>t' Af(t) = <?tM(0). For the quasi-equilibrium manifold 
and projector the matching condition (|34|l gives 

™(6*r(/M )) ^t(A^) for any macroscopic state M. (36) 
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Natural projector 



f=J(f) 0,f(O) = f(t) 


nE^Q, 71^=1 1 


0.(f*) 














0.{f*) 






\ f 


feQ 






Ansatz 






^ f* = F{f*) e Tf.Q 




0/{O) = f*(t) 





VfeQ 7r(0,f ) = 0,(f*) 



Fig. 6. Projection of segments of trajectories: The microscopic motion above the 
manifold O and the macroscopic motion on this manifold. If these motions begin 
in the same point on SI, then, after time r, projection of the microscopic state 
onto Q should coincide with the result of the macroscopic motion on H. For quasi- 
equilibrium fi, projector tt : E ^ H acts as n{f) — f^(f)- 



This condition is the equation for the macroscopic vector field ^{M). The 
solution of this equation is a function of r: if' = W{M,t). For sufficiently 
smooth microscopic vector field J{f) and entropy S{f) it is easy to find the 
Taylor expansion of ^{M, r) in powers of r. It is a straightforward exercise 
in differential calculus. Let us find the first two terms: <P{AI,t) = 'Fo{AI) + 
Ttf'i(M) + o(r). Up to the second order in r the matching condition 136|l is 

= MM)t + WiiAiy + {DmMM)){MM))y- (37) 

From this condition immediately follows: 

MM) = m(J(/l,)); (38) 
MM) = ^m[{DfJif))f=f.JJifl,)) - (i?MJ(/M))(m(J(/X,)))] 
= maDfJ{f))f=r,^ArJ 

where Zi/*^ is the defect of invariance H25() . The macroscopic equation in the 
first approximation is: 
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dM T 

— = m(J(/l,)) + -m{{DfJ{f))f^f.ArJ. (39) 

It is exactly the first Chapman-Enskog approximation %\[)\ for the model ki- 
netics (|26|l with £ — r/2. The first term rn{J{fl.i)) gives the quasi-equilibrium 
approximation, the second term increases dissipation. The formula for entropy 
production follows from H39|l [11]. If the initial microscopic kinetic H12|l is con- 
servative, then for macroscopic equation H39|l we obtain as for the Chapman- 
Enskog approximation: 

dS{M) T , ^ ^ ^ 

— — - ^ -{Af* ,Af~)f* , (40) 

where (•,•)/ is the entropic scalar product (|14(l . From this formula we see 
again a duality between the invariance of the quasi-equilibrium manifold and 
the dissipativity: entropy production is proportional to the square of the defect 
of invariance of the quasi-equilibrium manifold. 

For linear microscopic equations ( J(/) ~ Lf) the form of the macroscopic 
equations is 

dM 



— mL 
dt 



T 



^ + l^i^-^fl,)L fit, (41) 



where ttj*^ is the quasi-equilibrium projector l|23|) . 

The Navier-Stokes equation from the free flight dynamics 

The free flight equation describes dynamics of one-particle distribution func- 
tion f{x, v) due to free flight: 

df{x,v,t) ^ df{x,v,t) 

-^^ = -1^^^^^- (42) 

The difference from the continuity equation Q is that there is no velocity 
field v{x), but the velocity vector v is an independent variable. Equation H42() 
is conservative and has an explicit general solution 

f{x,v,t)^ fo{x-vt,v). (43) 

The coarse-graining procedure for 142|) serves for modeling kinetics with an 
unknown dissipative term /(/) 

'-^^-~T.^'-^^+^(f)- (44) 

i 

The Ehrenfests' chain realizes a splitting method for (|44|) : first, the free flight 
step during time r, than the complete relaxation to a quasi-equilibrium dis- 
tribution due to dissipative term /(/), then again the free flight, and so on. 
In this approximation the speciflc form of /(/) is not in use, and the only 
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parameter is time r. It is important that this hypothetical /(/) preserves 
all the standard conservation laws (number of particles, momentum, and en- 
ergy) and has no additional conservation laws: everything else relaxes. Fol- 
lowing this assumption, the macroscopic variables are: Mq = n(x, t) = J fdv, 
M, = nui ^ J v jdv {i = 1,2,3), = ^^i^ + nu^ = J v^fdv. The zero- 
order (quasi-equilibrium) approximation H21() gives the classical Euler equa- 
tion for compressible non-isothermal gas. In the first approximation H39|l we 
obtain the Navier-Stokes equations: 

dn d{nui) 



dt ^ dxi 

d{nuk) sr-^ d{nukUi) 1 dP 
dt ^ dxi m dxk 

i 

ll V — 

2 m ^ dx. 



\oxi dxk 3 



(45) 



where P = nk^aT is the ideal gas pressure, £ — ^ J v^f dv = ^"^^^ -I- is 
the energy density per unite mass (P = ^£ — ^u^, T = — g^^*^): 

and the underlined terms are results of the coarse-graining additional to the 
quasi-equilibrium approximation. 

The dynamic viscosity in l|45|l is /i = ^nk^T . It is useful to compare this 
formula to the mean-free-path theory that gives = T^oink^T — Tco\P, where 
Tcoi is the collision time (the time for the mean-free-path). According to these 
formulas, we get the following interpretation of the coarse-graining time r for 
this example: r = 2tco1. 

The equations obtained H45|l coincide with the first-order terms of the 
Chapman-Enskog expansion H3U|I applied to the BGK equations with Tcoi = 
t/2 and meet the same problem: the Prandtl number (i.e., the dimensionless 
ratio of viscosity and thermal conductivity) is Pr — 1 instead of the value 
Pr — I verified by experiments with perfect gases and by more detailed theory 
[80] (recent discussion of this problem for the BGK equation with some ways 
for its solution is presented in [81]). 

In the next order in r we obtain the stable post-Navier-Stokes equa- 
tions instead of the unstable Burnett equations that appear in the Chapman- 
Enskog expansion [11,76]. Here we can see the difference between two ap- 
proaches. 

Persistence of invariance and mistake of differential pursuit 

L.M. Lewis called a generalization of the Ehcrnfest's approach a "unifying 
principle in statistical mechanics," but he created other macroscopic equa- 
tions: he produced the differential pursuit (Fig. [7^) 
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Fig. 7. Differential pursuit of the projection point (a). The mistake of differential 
pursuit (b): invariant manifold should preserve its invariance, but it does not! 



dM ^ m{Or{fl,))-M 
dt T 

from the full matching condition (|34|l . This means that the macroscopic mo- 
tion was taken in the first-order Tailor approximation, while for the micro- 
scopic motion the complete shift in time (without the Taylor expansion) was 
used. The basic idea of this approach is a non-differential time separation; the 
infinitesimal shift in macroscopic time is always such a significant shift for 
microscopic time that no Taylor approximation for microscopic motion may 
be in use. This sort of non-standard analysis deserves serious attention, but 
its realization in the form of the differential pursuit (|46|l does not work prop- 
erly in many cases. If the quasi-equilibrium manifold is invariant, then the 
quasi-equilibrium approximation is exact and the Ehrenfests' chain (Fig. ^ 
just follows the quasi-equilibrium trajectory. But the differential pursuit does 
not follow the trajectory (Fig. this motion leaves the invariant quasi- 
equilibrium manifolds, and the differential pursuit does not approximate the 
Ehrenfests' chain, even qualitatively. 

Ehrenfests ' coarse-graining as a method for model reduction 

The problem of model reduction in dissipative kinetics is recognized as a 
problem of time separation and construction of slow invariant manifolds. One 
obstacle on this way is that the slow invariant manifold is the thing that 
many people would like to find, but nobody knows exactly what it is. There 
is no conventional definition of slow invariant manifold without explicit small 
parameter that tends to zero. It seems irow that the most reasonable way for 
such a definition is the analysis of induced dynamics of manifolds immersed 
into phase space. Fixed points of this dynamics are invariant manifolds, and 
asymptotically stable (stable and attracting) fixed points are slow invariant 
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■■ Hypothetic attractive invariant manifold 



T 




Fig. 8. Natural projector and attractive invariant manifolds. For large r, the natural 
projector gives the approximation of projection of the genuine motion from the 
attractive invariant manifold onto the initial ansatz manifold Q. 

manifolds. This concept was explicitly developed very recently [3,4,84], but 
the basic idea was used in earlier applied works [35,85]. 

The coarse-graining procedure was developed for erasing some details of 
the dynamics in order to provide entropy growth and uniform tendency to 
equilibrium. In this sense, the coarse-graining is opposite to the model reduc- 
tion, because for the model reduction we try to find slow invariant manifolds 
as exactly, as we can. But unexpectedly the coarse-graining becomes a tool 
for model reduction without any "erasing." 

Let us assume that for dissipative dynamics with entropy growth there 
exists an attractive invariant manifold. Let us apply the Ehrenfests' coarse- 
graining to this system for sufficiently large coarse-graining time r. For the 
most part of time r the system will spend in a small vicinity of the attractive 
invariant manifold. Hence, the macroscopic projection will describe the projec- 
tion of dynamics from the attractive invariant manifold onto ansatz manifold 
fl. As a result, we shall find a shadow of the proper slow dynamics without 
looking for the slow invariant manifold. Of course, the results obtained by 
the Taylor expansion (|37H39|I are not applicable for the case of large coarse- 
graining time T, at least, directly. Some attempts to utilize the idea of large 
T asymptotic are presented in [4] (Ch. 12). 

One can find a source of this idea in the first work of D. Hilbert about 
the Boltzmann equation solution [40] (a recent exposition and development of 
the Hilbert method is presented in [86] with many examples of applications). 
In the Hilbert method, we start from the local Maxwellian manifold (that is, 
quasi-equilibrium one) and iteratively look for "normal solutions." The nor- 
mal solutions fniv, n{x,t), u{x,t), T{x,t)) are solutions to the Boltzmann 
equation that depend on space and time only through five hydrodynamic 
fields. In the Hilbert method no final macroscopic equation arises. The next 
attempt to utilize this idea without macroscopic equations is the "equation 
free" approach [9,87]. 
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The Ehrenfests' coarse-graining as a tool for extraction of exact macro- 
scopic dynamics was tested on exactly solvable problems [73]. It gives also a 
new approach to the fluctuation-dissipation theorems [72] . 

2.4 Kinetic models, entropic involution, and the second order 
"Euler method" 

Time-step - dissipation decoupling problem 

Sometimes, the kinetic equation is much simpler than the coarse-grained dy- 
namics. For example, the free flight kinetics (|42|l has the obvious exact ana- 
lytical solution H43|) . but the Euler or the Navier-Stokes equations H45|l seem 
to be very far from being exactly solvable. In this sense, the Ehrenfests' chain 

(Fig. 13 gives a stepwise approximation to a solution of the coarse-grained 
(macroscopic) equations by the chain of solutions of the kinetic equations. 

If we use the second-order approximation in the coarse-graining proce- 
dure H37|l . then the Ehrenfests' chain with step t is the second-order (in 
time step r) approximation to the solution of macroscopic equation (|39|l . It 
is very attractive for hydrodynamics: the second-order in time method with 
approximation just by broken line built from intervals of simple free-flight 
solutions. But if we use the Ehrenfests' chain for approximate solution, then 
the strong connection between the time step t and the coefficient in equations 

(see also the entropy production formula 1001)) is strange. Rate of dissipa- 
tion is proportional to r, and it seems to be too restrictive for computational 
applications: decoupling of time step and dissipation rate is necessary. This 
decoupling problem leads us to a question that is strange from the Ehrenfests' 
coarse-graining point of view: how to construct an analogue to the Ehrenfests ' 
coarse- graining chain, but without dissipation? The entropic involution is a 
tool for this construction. 

Entropic involution 

The entropic involution was invented for improvement of the lattice-Boltzmann 
method [89] . We need to construct a chain with zero macroscopic entropy pro- 
duction and second order of accuracy in time step r. The chain consists of 
intervals of solution of kinetic equation H12|l that is conservative. The time 
shift for this equation is 0t- The macroscopic variables M — m{f) are cho- 
sen, and the time shift for corresponding quasi-equilibrium equation is (in 
this section) 0t. The standard example is: the free flight kinetics H42I43(I as 
a microscopic conservative kinetics, hydrodynamic fields (density-velocity- 
kinetic temperature) as macroscopic variables, and the Euler equations as a 
macroscopic quasi-equilibrium equations for conservative case (see H45II . not 
underlined terms). 

Let us start from construction of one link of a chain and take a point 
fi/2 on the quasi-equilibrium manifold. (It is not an initial point of the link. 
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/o, but a "middle" one.) The correspondent value of M is A/1/2 — ''Tt'ifi/2)- 
Let us define Mq = w(6'_^/2(/i/2)), Mi = m{0^/2{fi/2))- The dissipative 
term in macroscopic equations ()39|l is linear in r, hence, there is a symme- 
try between forward and backward motion from any quasiequilibrium initial 
condition with the second-order accuracy in the time of this motion (it be- 
came clear long ago [35]). Dissipative terms in the shift from Mo to M1/2 
(that decrease macroscopic entropy S{M)) annihilate with dissipative terms 
in the shift from M1/2 to Mi (that increase macroscopic entropy S{M)). As 
the result of this symmetry, Mi coincides with 0r{Mo) with the second-order 
accuracy. (It is easy to check this statement by direct calculation too.) 

It is necessary to stress that^the second-order accuracy is achieved on the 
ends of the time interval only: 0r{Mo) coincides with Mi = m-(G'r (/o)) in the 
second order in r ^ 

m{Orifo))-Or{Mo)=o{T^). 

On the way 0t{Mo) from Mq to 0t{Mo) for < t < t we can guarantee the 
first-order accuracy only (even for the middle point). It is essentially the same 
situation as we had for the Ehrenfests' chain: the second order accuracy of the 
matching condition H36|l is postulated for the moment r, and for < t < r the 
projection of the m{0t{fo)) follows a solution of the macroscopic equation H39|) 
with the first order accuracy only. In that sense, the method is quite different 
from the usual second-order methods with intermediate points, for example, 
from the Crank-Nicolson schemes. By the way, the middle quasi-equilibrium 
point, /1/2 appears for the initiation step only. After that, we work with the 
end points of links. 

The link is constructed. For the initiation step, we used the middle 
point fi/2 on the quasi-equilibrium manifold. The end points of the link, 
/o — 0-T/2{fi/2) s-nd fi = 6*t/2(/i/2) don't belong to the quasi-equilibrium 
manifold, unless it is invariant. Where are they located? They belong a surface 
that we call a film of non- equilibrium states [4,74,75]. It is a trajectory of the 
quasi-equilibrium manifold due to initial microscopic kinetics. In [4,74,75] we 
studied mainly the positive semi-trajectory (for positive time). Here we need 
shifts in both directions. 

A point / on the film of non-equilibrium states is naturally parameterized 
by M, t: f = qM,T, where M = m{f) is the value of the macroscopic variables, 
and t(/) is the time of shift from a quasi-equilibrium state: 0-r{f) is a quasi- 
equilibrium state. In the first order in r, 

QALr ^fh+rAf^^, (47) 

and the first-order Chapman-Enskog approximation (|29|l for the model BGK 
equations is also here with r = e. (The two-times difference between kinetic 
coefficients for the Ehrenfests' chain and the first-order Chapman-Enskog ap- 
proximation appears because for the Ehrenfests' chain the distribution walks 
linearly between qM,o and qM.r, and for the first-order Chapman-Enskog ap- 
proximation it is exactly qM,T-) 
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For each M and positive s from some interval ]0,^^[ there exist two such 
T±(M, s) {t+{M, s) > 0, T_(Af, s) < 0) that 

S{qM,r±iM,s)) ^ S{M) - s. (48) 

Up to the second order in t± 

^ = Y(^/m'^/X.)/I,+«(-±) (49) 

(compare to (001)), and 

r+ = -r_+o(r_); \r±\ - J , 1. ^(1 + »(!))■ (50) 

Equation H48|l describes connection between entropy change s and time co- 
ordinate T on the film of non-equilibrium states, and 149|l presents the first 
non-trivial term of the Taylor expansion of H48|) . 

The entropic involution Is is the transformation of the film of non- 
equilibrium states: 

ls{qM,T±) qM,r^- (51) 

This involution transforms t+ into t„, and back. For a given macroscopic 
state M, the entropic involution Is transforms the curve of non-equilibrium 
states qm.t h^to itself. 

In the first order in r it is just reflection qM,T — qM.-r- A partial lineariza- 
tion is also in use. For this approximation, we define nonlinear involutions of 
straight lines parameterized by a, not of curves: 

Isif) - /»(/) - "(/ - /™(/)), « > 0, (52) 
with condition of entropy conservation 

SilUf)) = Sif). (53) 

The last condition serves as equation for a. The positive solution is unique and 
exists for / from some vicinity of the quasi-equilibrium manifold. It follows 
from the strong concavity of entropy. The transformation Ig H53|l is defined 
not only on the film of non-equilibrium states, but on all distributions (mi- 
croscopic) / that are sufficiently closed to the quasi-equilibrium manifold. 

In order to avoid the stepwise accumulation of errors in entropy produc- 
tion, we can choose a constant step in a conservative chain not in time, but in 
entropy. Let an initial point in macro-variables Mq be given, and some s > 
be fixed. We start from the point fo = qM T-{Ma s)- At this point, for t — 0, 
5(m(0o(/o)))) - s = 5((0o(/o))) (Oo = id). Let the motion 0t{fo) evolve 
until the equality S{m{0t{fo))) — s = S{0t{fo)) is satisfied next time. This 
time will be the time step r, and the next point of the chain is: 
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Fig. 9. The regular (a) and irregular (b) conservative chain. Dissipative terms for the 
regular chain give zero balance inside each step. For the irregular chain, dissipative 
term of part I (the first step) annihilates with dissipative term of part IV (the second 
step), as well, as annihilate dissipartive terms for parts II and III. 



/l =/5(0r(/o)). (54) 

We can present this construction geometrically (Fig.|5^). The quasi-equiUbrium 
manifold, M* — {qM,o}, is accompanied by two other manifolds, Mj_(s) = 
{Qm.t±(m,s)}- These manifolds are connected by the entropic involution: 
/sMi(s) = M^(s). For all points / G M|(s) 

The conservative chain starts at a point on /o G M^i (s) , than the solution of 
initial kinetic equations, 0t{fo), goes to its intersection with ]V[!^(s), the mo- 
ment of intersection is r. After that, the entropic involution transfers 6*1- (/g) 
into a second point of the chain, fi = Isi^rifo)) G Ml(s). 

Irregular conservative chain 

The regular geometric picture is nice, but for some generalizations we need 
less rigid structure. Let us combine two operations: the shift in time &t and 
the entropic involution Is- Suppose, the motions starts on a point /o on the 
film of non-equilibrium states, and 

fn+l = IsiOrifn))- (55) 

This chain we call an irregular conservative chain, and the chain that moves 
from Ml(s) to M^(s) and back, the regular one. For the regular chain the 
dissipative term is zero (in the main order in r) already for one link because 
this link is symmetric, and the macroscopic entropy (S'(M)) loose for a motion 
from Ml(s) to M* compensate the macroscopic entropy production on a 
way from M* to M^j^(s). For the irregular chain H55|) with given r such a 
compensation occurs in two successive links (Fig. |^) in main order in t. 
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Fig. 10. Realization of dissipative chain by the extra time i9 on the base of a regular 
conservative chain (a), and by the incomplete involution on the base of an irregular 
conservative chain (b). 



Kinetic modeling j or non-zero dissipation. 1. Extension of regular chains 

The conservative chain of kinetic curves approximates the quasi-equiHbrium 
dynamics. A typical example of quasi-equilibrium equations (|21|l is the Euler 
equation in fluid dynamics. Now, we combine conservative chains construction 
with the idea of the dissipative Ehrenfests' chain in order to create a method 
for kinetic modeling of dissipative hydrodynamics ( "macrodynamics" ) H39|l 
with arbitrary kinetic coefficient that is decoupled from the chain step r: 

^ = m{J(flj)) + n(M)m[{DfJ{f))f=f.^Af>J. (56) 

Here, a kinetic coefficient k{M) > is a non-negative function of M . The 
entropy production for H10() is: 

^ = «W(%.'^/m>/m- (57) 

Let us start from a regular conservative chain and deform it. A chain that 
approximates solutions of lf3^ can be constructed as follows (Fig. ITUk). The 
motion starts from /q G M1(s), goes by a kinetic curve to intersection with 
M^(s), as for a regular conservative chain, and, after that, follows the same 
kinetic curve an extra time d. This motion stops at the moment r + at the 
point Or+^ifo) (Fig. llOb). The second point of the chain, /i is the unique 
solution of equation 

m(/i) - m(©,+4/o)), /i e Ml(s). (58) 
The time step is linked with the kinetic coefficient: 

K=-+o(r + i9). (59) 

For entropy production we obtain the analogue of H4U|) 
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'^-'^<^n.-^,:Jn.^o(r^,y (60) 

All these formulas follow from the first-order picture. In the first order of the 
time step, 

Qalt = /m + rAf*^ ; 

T 

e?*(/o) + (61) 

and up to the second order of accuracy (that is, again, the first non-trivial 
term) 

S{qM,r) = S{M) + ^{Af,^,ArJf,^. (62) 
For a regular conservative chains, in the first order 

/i=/mm-^^/1v (63) 
For chains ()58|l . in the first order 

/l=/M(r+^)-^^/,%- (64) 

Kinetic modeling for non-zero dissipation. 2. Deformed involution in 
irregular chains 

For irregular chains, we introduce dissipation without change of the time step 
T. Let us, after entropic involution, shift the point to the quasi-equilibrium 
state fFig. I10|l with some entropy increase a{M). Because of entropy produc- 
tion formula (|57() . 

a{M)=TK{M){Af.^,Af.Jf.^^. (65) 

This formula works, if there is sufhcient amount of non-equilibrium entropy, 
the difference S{Mn) — S{fn) should not be too small. In average, for several 
(two) successive steps it should not be less than a{M). The Ehrenfests' chain 
gives a limit for possible value of k{M) that we can realize using irregular 
chains with overrelaxation: 

<M) < ^. (66) 

Let us call the value k{M) — ^ the Ehrenfests' limit. Formally, it is possible 
to realize a chain of kinetic curves with time step r for k(M) > ^ on the other 
side of the Ehrenfests' limit, without overrelaxation fFig. Illll . 

Let us choose the following notation for non-equilibrium entropy: so — 
S{Mo) - 5(/o), si = 5(Mi) - 5(/i), Sr{M) = i;-{Af,,.Af,,)n,. For the 
three versions of steps fFig. [TT|l the entropy gain a — s{fx) — S{Is{Or{fo))) 
in the main order in r is: 
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Fig. 11. The Ehrenfests' limit of dissipation: three possible links of a dissipative 
chain: overrelaxation, k{M) < J {{a) = St — 1\J St{so)), Ehrenfests' chain, k{A'I) — 
I (cr = St), and underrelaxation, k{M) > ^ ((a) = St + 2^ Sr(so))- 



• For overrelaxation (k(M) < ^) a = Sr + sq — si — 2y/SrSo] 

• For the Ehrenfests' chain (full relaxation, k(M) — ^) sq = si = and 

• For underrelaxation (k(M) > J) <t = + sq — si + 2y^s7so- 

After averaging in successive steps, the term sq — si tends to zero, and 
we can write the estimate of the average entropy gain (cr) : for overrelaxation 
(cr) = St — 2-^/ Sr(so) and for underelaxation (a) = St + 2-\/ Sr (so)- 

In the really interesting physical problems the kinetic coefficient k{AI) 
is non-constant in space. Macroscopic variables M are functions of space, 
k{M) is also a function, and it is natural to take a space-dependent step of 
macroscopic entropy production cr(A/). It is possible to organize the involu- 
tion (incomplete involution) step at different points with different density of 
entropy production step cr. 

Which entropy rules the kinetic model? 

For linear kinetic equations, for example, for the free flight equation H42|l there 
exist many concave Lyapunov functionals (for dissipative systems) or integrals 
of motion (for conservative systems), see, for example, 

There are two reasonable conditions for entropy choice: additivity with 
respect to joining of independent systems, and trace form (sum or integral of 
some function h{f, /*)). These conditions select a one-parametric family [43, 
44] , a linear combination of the classical Boltzmann-Gibbs-Shannon entropy 
with h{f) = —/In/ and the Burg Entropy with h{f) = In/, both in the 
Kullback form: 

Sa^^aJ /ln^dr(x) + (l-a) J /*ln^dr(x), 

where 1 > a > 0, and f*dr is invariant measure. Singularity of the Burg term 
for / — > provides the positivity preservation in all entropic involutions. 
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If we weaken these conditions and require that there exists such a mono- 
tonic (nonhnear) transformation of entropy scale that in one scale entropy is 
additive, and in transformed one it has a trace form, then we get additionally 
a family of Renyi-Tsallis entropies with h{f) — ^^J^ [44] (these entropies and 
their applications are discussed in details in [45]). 

Both the Renyi-Tsallis entropy and the Burge entropy are in use in the 
entropic lattice Boltzmann methods from the very beginning [46,89]. The 
connection of this entropy choice with Galilei invariance is demonstrated in 
[46]. 

Elementary examples 

In the most popular and simple example, the conservative formal kinetic 
equations (|12|l is the free flight equation 142|l . Macroscopic variables M are 
the hydrodynamic fields: n{x) = j f{x,v)dv, n{x)u{x) = Jvf{x,v)dv, 
3n{x)kBT/2m =5/ v^f{x,v)dv — ^n{x)u'^{x), where m is particle mass. 
In 3D at any space point we have five independent variables. 

For a given value of five macroscopic variables M = {n,u,T} (3D), the 
quasi-equilibrium distribution is the classical local Maxwellian: 

rMM=n[—-)^ oxp(^-^^j, (67) 

The standard choice of entropy for this example is the classical Boltzmann- 
Gibbs-Shannon entropy jSJ) with entropy density s{x). All the involution op- 
erations are performed pointwise: at each point x we calculate hydrodynamic 
moments M, the correspondent local Maxwellian (|67() /^j, and find the en- 
tropic inversion at this point with the standard entropy. For dissipative chains, 
it is useful to take the dissipation (the entropy density gain in one step) pro- 
portional to the S{M) — S{f), and not with fixed value. 

The special variation of the discussed example is the free flight with finite 
number of velocities: f{x, v) = fi{^)^{v ~ t'i)- Free flight does not change 

the set of velocities {vi, If we define entropy, then we can define an 

equilibrium distribution for this set of velocity too. For the entropy definition 
let us substitute (5-functions in expression for f{x, v) by some "drops" with 
unite volume, small diameter, and fixed density that may depend on i. After 
that, the classical entropy formula unambiguously leads to expression: 

s{x)^-Y,Mx)(^\n^-iy (68) 

This formula is widely known in chemical kinetics (see elsewhere, for exam- 
ple [34-36]). After classical work of Zeldovich [37] (1938), this function is 
recognized as a useful instrument for analysis of chemical kinetic equations. 
Vector of values /" = gives us a "particular equilibrium:" for M = m(/°) 
the conditional equilibrium (s max, M ~ m{f^)) is /°. With entropy H68(l 
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we can construct all types of conservative and dissipative chains for discrete 
set of velocities. If we need to approximate the continuous local equilibria and 
involutions by our discrete equilibria and involutions, then we should choose 
a particular equilibrium distribution '^ifiS{v — Vi) in velocity space as an 
approximation to the Maxwellian f*'^{v) with correspondent value of macro- 
scopic variables M° calculated for the discrete distribution f^: n — '^^fi, 
... This approximation of distributions should be taken in the weak sense. It 
means that Vi are nodes, and /f are weights for a cubature formula in 3D 
space with weight 



There exist a huge population of cubature formulas in 3D with Gaussian 
weight that are optimal in various senses [95]. Each of them contains a hint 
for a choice of nodes Vi and weights ff for the best discrete approximation of 
continuous dynamics. Applications of this entropy H68|l to the lattice Boltz- 
mann models are developed in [93]. 

There is one more opportunity to use entropy l|()8|l and related involutions 
for discrete velocity systems. If for some of components fi — 0, then we can 
find the correspondent positive equilibrium, and perform the involution in the 
whole space. But there is another way: if for some of velocities fi = 0, then we 
can reduce the space, and find an equilibrium for non-zero components only, 
for the shortened list of velocities. These boundary equilibria play important 
role in the chemical thermodynamic estimations [96]. 

This approach allows us to construct systems with variable in space set 
of velocities. There could be "soft particles" with given velocities, and the 
density distribution in these particles changes only when several particles 
collide. In 3D for the possibility of a non-trivial equilibrium that does not 
obligatory coincide with the current distribution we need more than 5 different 
velocity vectors, hence, a non-trivial collision entropic inversion) is possible 
only for 6 one- velocity particles. If in a collision participate 5 one- velocity 
particles or less, then they are just transparent and don't interact at all. For 
more moments, if we add some additional fields (stress tensor, for example), 
the number of velocity vectors that is necessary for non-trivial involution 
increases. 

Lattice Boltzmann models: lattice is not a tool for discretization 

In this section, we presented the theoretical backgrounds of kinetic modeling. 
These problems were discussed previously for development of lattice Boltz- 
mann methods in computational fluid dynamics. The "overrelaxation" ap- 
peared in [88]. In papers [90,91] the overrelaxation based method for the 
Navier-Stokes equations was further developed, and the entropic involution 
was invented in [89]. Due to historical reasons, we propose to call it the Karlin- 
Succi involution. The problem of computational stability of entropic lattice 




(69) 
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Boltzmann methods was systematically analyzed in [93,94]. 77-theorem for lat- 
tice Boltzmann schemes was presented with details and applications in [92]. 
For further discussion and references we address to [19]. 

In order to understand links from the Ehrenfests' chains to the lattice 
Boltzmann models, let us take the model with finite number of velocity vec- 
tors and entropy 1)68(1 . Let the velocities from the set {vi, Vn} be auto- 
morphisms of some lattice L: L, + Vi = L. Then the restriction of free flight 
in time r on the functions on the lattice rL is exact. It means that the free 
flight shift in time t, f{x,v) i— *■ f{x — vt,v) is defined on functions on the 
lattice, because ViT are automorphisms of rL. The entropic involution (com- 
plete or incomplete one) acts pointwise, hence, the restriction of the chains 
on the lattice tL is exact too. In that sense, the role of lattice here is essen- 
tially different from the role of grid in numerical methods for PDE. All the 

discretization contains in the velocity set {vi, I'n}, and the accuracy of 

discretization is the accuracy of cubature formulas (|69|l . 

The lattice rL is a tool for presentation of velocity set as a subset of L 
automorphism group. At the same time, it is a perfect screen for presentation 
of the chain dynamics, because restriction of that dynamics on this lattice is 
an autonomous dynamic of lattice distribution. (Here we meet a rather rare 
case of exact model reduction.) 

The boundary conditions for the lattice Boltzmann models deserve special 
attention. There were many trials of non-physical conditions until the proper 
(and absolutely natural) discretization of well-known classical kinetic bound- 
ary conditions (see, for example, [80]) were proposed [97]. It is necessary and 
sufficient just to describe scattering of particles on the boundary with maxi- 
mal possible respect to the basic physics (and given proportion between elastic 
collisions and thermalization). 

3 Coarse-graining by filtering 

The most popular area for filtering applications in mathematical physics is 
the Large Eddy Simulation (LES) in fluid dynamics [17]. Perhaps, the first 
attempt to turbulence modeling was done by Boussinesq in 1887. After that, 
Taylor (1921, 1935, 1938) and Kolmogorov (1941) have provided the bases of 
the statistical theory of turbulence. The Kolmogorov theory of turbulence self 
similarity inspired many attempts of so-called subgrid-scale modeling (SGS 
model) : only the large scale motions of the flow are solved by filtering out the 
small and universal eddies. For the dynamic subgrid-scale models a filtering 
step is required to compute the SGS stress tensor. The filtering a hydrody- 
namic field is defined as convoluting the field functions with a filtering kernel, 
as it is done in electrical engineering: 




(70) 



34 Alexander N. Gorban 



Various filter kernels are in use. Most popular of them are: 

1. Tlie box filter G{x) = H{A/2 ~ \x\)/A; 

2. The Gaussian filter G{x) = ^y^Aexp (-6a;2/Z\2), 

where A is the filter width (for the Gaussian filter, A/2 = VScr, this conven- 
tion corresponds to 91.6% of probability in the interval [—A/2, +A/2] for the 
Gaussian distribution) , H is the Heaviside function, G{x) — J|- G{xi). 

In practical applications, implicit filtering is sometimes done by the grid 
itself. This filtering by grids should be discussed in context of the Whittaker- 
Nyquist-Kotelnikov-Shannon sampling theory [98,99]. Bandlimited functions 
(that is, functions which Fourier transform has compact support) can be ex- 
actly reconstructed from their values on a sufhciently fine grid by the Nyquist- 
Shannon interpolation formula and its multidimensional analogues. If, in ID, 
the Fourier spectrum of f{x) belongs to the interval [— fcmax, ^max], and the 
grid step h is less than Tr/ftmax (it is, twice less than the minimal wave length), 
then this formula gives the exact representation of /(x) for all points x: 



-too 

fi^) = /("-'i)sinc (tt ^ - ) > (71) 



n— — oo 



where sinc(a;) — That interpolation formula implies an exact differenti- 
ation formula in the nodes: 



dfix) 



dx 



o V^^ 1 ^fc+l /((" + - fijn - k)h) 
= 2.}^(~1) — . (72) 

x—nh k—1 



Such "long tail" exact differentiation formulas are useful under assumption 
about bounded Fourier spectrum. 

As a background for SGS modeling, the Boussinesq hypothesis is widely 
used. This hypothesis is that the turbulent terms can be modeled as di- 
rectly analogues to the molecular viscosity terms using a "turbulent viscosity." 
Strictly speaking, no hypothesis are needed for equation filtering, and below a 
sketch of exact filtering theory for kinetic equations is presented. The idea of 
reversible regularization without apriory closure assumptions in fluid dynam- 
ics was proposed by Leray [13]. Now it becomes popular again [100, 102, 103]. 



3.1 Filtering as auxiliary kinetics 

Idea of filtering in kinetics 

The variety of possible filters is too large, and we need some fundamental 
conditions that allow to select physically reasonable approach. 

Let us start again from the formal kinetic equation (|12|l df/dt = J{f) 
with concave entropy functional iS'(/) that does not increase in time and is 
defined in a convex subset U of a vector space E. 

The filter transformation <l>^ : U ~^ U, where A is the filter width, should 
satisfy the following conditions: 
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1. Preservation of conservation laws: for any basic conservation law of the 
form C[f] = const filtering does not change the value C[f]: C[<?/i(/)] — 
C[f]. This condition should be satisfied for the whole probability or for 
number of particles (in most of classical situations) , momentum, energy, 
and filtering should not change the center of mass, this is not so widely 
known condition, but physically obvious consequence of Galilei invariance. 

2. The Second Law (entropy growth): 5(<Z'zi(/)) > S{f). 

It is easy to check the conservation laws for convoluting filters (|70ll . and here 
we find the first benefit from the kinetic equation filtering: for usual kinetic 
equations and all mentioned conservation laws functionals C[f] are linear, 
and the conservation preservation conditions are very simple linear restric- 
tions on the kernel G (at least, far from the boundary). For example, for the 
Boltzmann ideal gas distribution function f{x,v), the number of particles, 
momentum, and energy conserve in filtering f{x, v) — J G{x — y)f{y, v) dy, 
if / G{x) da; = 1; for the center of mass conservation we need also a symmetry 
condition j xG{x) dx — 0. It is necessary to mention that usual filters extend 
the support of distribution, hence, near the boundary the filters should be 
modified, and boundary can violate the Galilei invariance, as well, as momen- 
tum conservation. We return to these problems in this paper later. 

For continuum mechanics equations, energy is not a linear functional, and 
operations with filters require some accuracy and additional efforts, for ex- 
ample, introduction of spatially variable filters [101]. Perhaps, the best way 
is to lift the continuum mechanics to kinetics, to filter the kinetic equation, 
and then to return back to filtered continuum mechanics. On kinetic level, 
it becomes obvious how filtering causes the redistribution of energy between 
internal energy and mechanical energy: energy of small eddies and of other 
small-scale inhomogeneities partially migrates into internal energy. 

Filtering semigroup 

If we apply the filtering twice, it should lead just just to increase of the filter 
width. This natural semigroup condition reduces the set of allowed filters 
significantly. The approach based on filters superposition was analyzed by 
Germano [15] and developed by many successors. Let us formalize it in a form 

<l>A'{-PA{f))=-PA"{f), (73) 

where A" {A', A) is a monotonic function. A" > A' and A" > A. 

The semigroup condition (|73|l holds for the Gaussian filter with A"^ — 
Z\'^ + Z\^, and does not hold for the box filter. It is convenient to parameterize 
the semigroup {«?zi|Z\ > 0} by an additive parameter rj > ("auxiliary time"): 
A = A{i]), o (pjj, = ^0 — id. Further we use this parameterization. 

Auxiliary kinetic equation 

The filtered distribution f{ri) = ?^r((/o) satisfies differential equation 
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^ - 0(/(77)), where </.(/) = lim ^!lIZL^. (74) 

For Gaussian filters this equation is the simplest diffusion equation d/(ry) /dry = 
A/ (here A is the Laplace operator). 

Due to physical restrictions on possible filters, auxiliary equation 1)74(1 has 
main properties of kinetic equations: it respects conservation laws and the 
Second Law. It is also easy to check that in the whole space (without boundary 
effects) diffusion, for example, does not change the center of mass. 

So, when we discuss filtering of kinetics, we deal with two kinetic equations 
in the same space, but in two times t and rj: initial kinetics H12|) and filtering 
equation H74[l. Both have the same conservation laws and the same entropy. 



3.2 Filtered kinetics 

Filtered kinetic semigroup 

Let 0t be the semigroup of the initial kinetic phase flow. We are looking for 
kinetic equation that describes dynamic of flltered distribution ^,,/ for given 
r]. Let us call this equation with correspondent dynamics the filtered kinetics. 
It is the third kinetic equation in our consideration, in addition to the initial 
kinetics (|12|) and the auxiliary filtering kinetics H74|) . The natural phase space 
for this filtered kinetics is the set of filtered distributions <?,,([/). For the phase 
fiow of the filtered kinetics we use notation ^ This filtered kinetics should 
be the exact shadow of the true kinetics. It means that the motion t(^^/o) 
is the result of filtering of the true motion 0t{fo)- for any foEU and t > 

>F^^)t{'Pvfo)=-^vi^t{fo))- (75) 

This equality means that 

t^^rjOOtO <P_^ (76) 

The transformation <?_^ is defined on the set of filtered distributions (J7), 
as well as >f'(^) t is. Now it is necessary to find the vector field 



^(r,)(/) 



dt 



t=o 



on the base of conditions ((75|l . ((76|l . This vector field is the right-hand side of 
the filtered kinetic equations 



dt 



From 17()|l immediately follows: 
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dr] 



{Df^im^^^if) - - [^(,) >](/), (78) 



where [-0, (f>] is the Lie bracket of vector fields. 
In the first approximation in i] 

^iv)if) = Jif)+viiDfm)Jif)-iDfJifmf)) = j{f)+v[j,m), (79) 

the Taylor series expansion for ip(^^-^{f) is 

2 n 

if) = J if) + v[J, 4>] (/) + ^ [[J>] , 0] (/) + ... + ^ [.. . [J, 0]^(/) + . . . 

n 

(80) 

We should stress again that filtered equations H77|l with vector field ?/'(?)) (/) 
that satisfies (|78ll is exact and presents just a shadow of the original kinetics. 
Some problems may appear (or not) after truncating the Taylor series (|8(J|I . 
or after any other approximation. 

So, we have two times: physical time t and auxiliary filtering time r/, and 
four different equations of motion in these times: 

• initial equation (|12|) (motion in time t), 

• filtering equation (|74|l (motion in time 77), 

• filtered equation (|77|l (motion in time t), 

• and equation for the right hand side of filtered equation l|78|) (motion in 
time 77). 

Toy example: advection + diffusion 

Let us consider kinetics of system that is presented by one scalar density in 
space (concentration) , with only one linear conservation law, the total number 
of particles. 

In the following example the filtering equation H74|l is 

^Ii^^Af{x,r,)i=m). (81) 

The differential of (j>{f) is simply the Laplace operator A. The correspondent 
3D heat kernel (the fundamental solution of (|81|) ) is 

Kirhx-0 = —^exp(-^^^-^]. (82) 



(4^77)3/2 ^ \^ 477 

After comparing this kernel with the Gaussian filter we find the filter width 
A = V24^. 

Here we consider the diffusion equation l|81|) in the whole space with zero 
conditions at infinity. For other domains and boundary conditions the filtering 
kernel is the correspondent fundamental solution. 
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The equation for the right hand side of filtered equation H78|) is 

dV-C,,) (/) 



drj 



M^(r,)if)) - (2?/^(,)(/))(A/) (= [i',m))- 



For the toy example we select the advection + diffusion equation 

df{x,t) 



dt 



nAfix, t) - divivix)f{x, t)) (= J(/)). 



(83) 



(84) 



where k > is a given diffusion coefhcient, v{x) is a given velocity field. The 
differential DfJ{f) is simply the differential operator from the right hand 
side of H84|l . because this vector field is linear. After simple straightforward 
calculation we obtain the first approximation H79|l to the filtered equation: 

[J, m) = A(J(/)) - {DfJ{f)){M) = -A[div(t;/)] + div(t;A/) (85) 

dv df 



div[t;A/ - A{vf)] = -div 



fAv + 2Y, 



d 



-div(/A.)-i: 
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The resulting equations in divergence form are 

df{x,t) 



dt 



= j{f)+v[j.m) 



(86) 



^-div(^-«V/+(. + ,A.)/ + 2,^|i^) 



div((K - 277S'(a;))V/(a;, t)) ~ div((i;(a;) + r;Vdivt;(a;))/(a;, <)), 



where S{x) ^ (S,,) = 



is the strain tensor. In filtered equations 
H86|) the additional diffusivity tensor —2riS{x) and the additional velocity 
r]\/diYv{x) are present. The additional diffusivity tensor —2riS{x) may be 
not positive definite. The positive definiteness of the diffusivity tensor k — 
2r]S{x) may be also violated. For arbitrary initial condition foix) it may 
cause some instability problems, but we should take into account that the 
filtered equations l|86|l are defined on the space of filtered functions for given 
filtering time rj. On this space the negative diffusion {dtf = —A/) is possible 
during time rj. Nevertheless, the approximation of exponent (|80|l by the linear 
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term ()79|l can violate the balance between smoothed initial conditions and 
possible negative diffusion and can cause some instabilities. 

Some numerical experiments with this model H8t)|) for incompressible flows 
{divv = 0) are presented in [103]. 

Let us discuss equation in more details. We shall represent it as the 
dynamics of the filtered advection flux vector U . The filtered equation for 
any 77 should have the form: df/dt = — div(— kV/ + 11(f)), where 

n{f)^l a,,,,,six,rj)di^^^A fix), (87) 

Vlj2,i3>0 J 

where 

d VW d y / d 



For coefficients aj^j^j^{x,ri) equation ()83|l is 



r, dciji-ij2h i^^v) _^ r, 9a.j^j^^ij,ix,r]) ^ ^ daj,j^j^-i{x,i]) 
dxi dx2 8x3 



The initial conditions are: aooo(3^,0) = v{x), Oj^j^jg (a;, 0) = if at least one 
of jk > 0. Let us define formally aj^j^j.^{x,r]) = if at least one of jk is 
negative. 

We shall consider 1)89(1 in the whole space with appropriate conditions at 
infinity. There are many representation of solution to this system. Let us use 
the Fourier transformation: 

^^^i^f^ = -^'%U2.3(fe,ry) (90) 
+2»(^iaji-ij2j3(fe>^) + fc2aju2-ij3(fe.'7) + k3aj^j^j^-i{k,r])). 
Elementary straightforward calculations give us: 



a,,,,,3(fc,^) = (2^r;)l^■|e-'^^''M;^*(fc 



(91) 

where \j\ = ji + j2 + js- To find this answer, we consider all monotonic 
paths on the integer lattice from the point (0,0,0) to the point {ji, j2, js)- In 
concordance with 1)90(1 , every such a path adds a term 

to aj^j^j^{k,if). The number of these paths is {ji^-i2^-i?}-)- 
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The inverse Fourier transform gives 

annni^^v) = i'^v)^'^-"^ ^f-j-, / exp -L— dy. (92) 

Jlh2W- J 47? 



Finally, for U we obtain 



n{f) (93) 

= E ^^m'','? f^^^'^'' / exp-^^-^^(y)dy) di^^^=^f{x). 

By the way, together with (|93|l we received the following formula for the 
Gaussian filtering of products [103]. If the semigroup <Prj is generated by the 
diffusion equation H81|l . then for two functions f{x),g{x) in i?" (if all parts 
of the formula exist): 

J1J2,...J„>0^1--^2....J«. 

Generalization of this formula for a broader class of filtering kernels for con- 
volution filters is described in [16]. This is simply the Taylor expansion of the 
Fourier transformation of the convolution equality = 'P o Ot o where 
^ is the filtering transformation (see (|7S|l '). 

For filtering semigroups all such formulas are particular cases of the com- 
mutator expansion H8U|) , and calculation of all orders requires differentiation 
only. This case includes non-convolution filtering semigroups also (for exam- 
ple, solutions of the heat equations in a domain with given boundary condi- 
tions, it is important for filtering of systems with boundary conditions), as 
well as semigroups of non-linear kinetic equation. 

Nonlinear filtering toy example 

Let us continue with filtering of advection -t- diffusion equation (|84|l and accept 
the standard assumption about incompressibility of advection flow v: diw — 
0. The value of density / does not change in motion with the advection flow, 
and for diffusion the maximum principle exists, hence, it makes sense to study 
bounded solutions of (|84(l with appropriate boundary conditions, or in the 
whole space. Let us take max / < A. This time we use the filtering semigroup 



drj 



= -div(-(A - /)V/) = {A- f)Afix, 77) - (VfY (- 0(/)). (95) 



This semigroup has slightly better properties of reverse filtering (at least, no 
infinity in values of /). The first-order filtered equation ()79|l for this filter is 
(compare to (jHHl): 
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dfix,t) 



j{.f)+v[j,m) 

-div[-«:V(/ + r?(V/)2) + 2f]{A - f)SW,f + vf 



(96) 



dt 



Here, S is the strain tensor, the term —2ri{A — f)S is the additional (nonUn- 
ear) tensor difFusivity, and the term r]nW{W f)^ describes the flux from areas 
with high / gradient. Because this flux vanishes near critical points of /, it 
contributes to creation of a patch structure. 

In the same order in jy, it is convenient to write: 



The nonlinear fllter changes not only the diffusion coefficient, but the 
correspondent thermodynamic force also: instead of —V/ we obtain — V(/ + 
?7(V/)^). This thermodynamic force depends on / gradient and can participate 
in the pattern formation. 

LES + POD filters 

In the title, LES stands for Large Eddy Simulation, as it is before, and POD 
stands for Proper Orthogonal Decomposition. POD [104] is an application of 
principal component analysis [105] for extraction of main components from 
the ffow dynamics. The basic procedure is quite simple. The input for POD is 
a finite set of flow images (a sample) {/i, .... /„}. These images are functions 
in space, usually we have the values of these function on a grid. In the space of 
functions an inner product is given. The first choice gives the L2 inner product 
J fgdx, or energetic one, or one of the Sobolev's space inner products. The 
mean point tpo = J2i fi/^ minimizes the sum of distance squares ^iifi — tpof- 
The first principal component tpx minimizes the sum of distance squares from 
points fi to a straight line {V'o+aV'i | a G i?}, the second principal component, 
■i/'2, is orthogonal to -01 and minimizes the sum of distance squares from points 
fi to a plain {f/'o + ctiipi + a2V'2 | Cii^2 G R}, and so on. Vectors of principal 
components ipi are the eigenvectors of the sample covariance matrix S, sorted 
by decreasing eigenvalue Aj, where 



The projection of a field / on the plane of the k first principal components 
is ipQ + Pk{f), where Pk is the orthogonal projector on the space spanned by 
the first k components: 



df{x,t) 

dt 



= -div[-(/c - 2r]{A - f)S)V{f + r?(V/)2) + vf]. 



^ = - J2ifi - ^0) {fi - i'of = -J2\fi- ^o){fi - M (97) 




(98) 



l<j<k 



The average square distance from the sample points fi to the plane of the k 
first principal components is 
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j>fe i<j<fc V « / 

This number, Uj, measures the accuracy of substitution of the typical (in 
this sample) field / by its projection on the plane of the k first principal 
components. 

Among many applications of POD in fluid dynamics at least two have 
direct relations to the coarse-graining: 

• Postprocessing, that is, analysis of an experimentally observed or numer- 
ically computed flow regime in projection on the finite-dimensional space 
of the first principal components; 

• Creation of "optimal" Galerkin approximations (Galerkin POD, [106]). In 
this approach, after finding principal components from sampled images 
of flow, we project the equations on the first principal components, and 
receive a reduced model. 

In addition to radical and irreversible step from initial equations to Galerkin 
POD, we can use POD filtering semigroup. It suppresses the component of 
field orthogonal to selected k first principal components, but makes this re- 
versibly. The filtering semigroup is generated by auxiliary equation 

^ = '^(/W)--(l-P.)(/-V^o). (100) 
The filter transformation in explicit form is 

C^r,(/) = ^0 + [Pk + C-''(l - Pk)){f - V'O). (101) 

with explicit reverse transformation 

For equations of the form (|12|l / = J(/), the POD filtered equations are 

^ = (i?/C/,(/))a_„(/)(J(C/_,(/))) - {Pk + e-''(l - Pfe))(J([/_,,/)). (102) 

These equations have nonconstant in space coefficients, because Pk is com- 
bined from functions They are also non-local, because Pk includes integra- 
tion, but this non-locality appears in the form of several inner products (mo- 
ments) only. Of course, this approach can be combined with usual filtering, 
nonlinear Galerkin approximations [107], and non-linear principal manifold 
approaches [108]. 

Main example: the BGK model kinetic equation 

The famous BGK model equation substitutes the Boltzmann equation in all 
cases when we don't care about exact collision integral (and it is rather often, 
because usually it is difficult to distinguish our knowledge about exact collision 
kernel from the full ignorance). 
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For the one-particle distribution function f{x,v,t) the BGK equation 
reads: 

Ql + 2^^' — Q^. — = — (103) 

i 4 CO 

where m{ f) — M[t) is the cortege of the hydrodynamic fields that corresponds 
to f{x,v,t), and /^{f} the correspondent local Maxwellian. Let us rescale 
variables x,v,t: we shall measure x in some characteristic macroscopic units 
L, V in units of thermal velocity vt for a characteristic temperature, t in units 
L/vt- Of course, there is no exact definition of the "characteristic time" or 
length, but usually it works if not take it too serious. After rescaling, the BGK 
equation remains the same, only the parameter becomes dimensionless: 

df(x,vA) v-^ df(x,v,t) 1 , ^ „/ NN 

i 

where Kn = l/L is the dimensionless Knudscn number (and I is the mean- 
free-path). It is the small parameter in the kinetics - fluid dynamics transition. 
If the Kn > 1 then the continuum assumption of fluid mechanics is no longer 
a good approximation and kinetic equations must be used. 

It is worth to mention that the BGK equation is non-linear. The term 
fm{f) depends non-linearly on moments m{f), and, hence, on the distribution 
density / too. And /^(f) the only term in H103() that don't commute with 
the Laplace operator from the filtering equation (|81() . All other terms do not 
change after filtering. 

According to (|7^ . in the first order in ij the filtered BGK equation is 

Tt^2Z-^d^^ (105) 

i 

= ]^(/™(/) - /) + ]|(^m/m)m=™(/)(VM, VM)m=™(/). 

The last notation may require some explanations: (Dm/m) is the second dif- 
ferential of flj, for the BGK model equation it is a quadratic form in that 
parametrically depends on moment value M — {Mq, Mi, M2, M3, M4}. In the 
matrix form, the last expression is 

(^M/M)M=™(/)(VAf, VM)m=™(/) (106) 



EE 



V dMj Mi J .f , t-^ dxr dxr 
, _lij=0 ^ * J / M=m{J) r r 

This expression depends on the macroscopic fields M only. From identity 
1)201) it follows that the filtering term gives no inputs in the quasi-cquilibrium 
approximation, because m{Dj^,j f^j) = 0. 
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This fact is a particular case of the general commutation relations for 
general quasi-equilibrium distributions. Let a linear operator B acts in the 
space of distributions /, and there exists such a linear operator b which acts 
in the space of macroscopic states M that mB = bm. Then 

m(B/;;(/)-(i?//;;(/))(B/)) = o. (lo?) 

This means that the macroscopic projection of the Lie bracket for the vector 
fields of equations 9^/ — B/ (a field (j)) and dtf = f^(^f-^ — / (a field 6) is 
zero: m([0, 0]) = 0.^ These commutation relations follow immediately from 
the self-consistency identities H18|) . (|19(l . if we use relations toB = bm to 
carry m through B. In the case of BGK equation, relations H107() hold for 
any linear differential or pseudodifferential operator B = Q{x,d/dx) that 
acts on functions of a;. In this case, b = B, if we use the same notation for 
differentiation of functions and of vector-functions. 

Relations (|107|l imply a result that deserves special efforts for physical 
understanding: the filtered kinetic equations in zero order in the Knudsen 
number produce the classical Eulcr equations for filtered hydrodynamic fields 
without any trace of the filter terms. At the same time, direct filtering of the 
Euler equation adds new terms. 

To obtain the next approximation we need the Chapman-Enskog method 
for equation (|105|l . We developed a general method for all equations of this 
type H29|l . and now apply this method to the filtered BGK equation. Let us 
take iii^ Kn, F{f) = Fo{f) + Fmt{f), where Fq = -vd/dx is the free 
flight operator and 

i^filt(/) = ■^iDlirM)M=mif){VM, VM)m=™(/). (108) 

In these notations, for the zero term in the Chapman-Enskog expansion we 
have /IJ'' = f^.j, and for the first term 

/l^^ = /r/+/f;* = ^f +4!' (109) 

= Af^ = Foifh) - {DMrM)imiFo{rM))) 
/i;* = Z\^l* = Ffiit(/) (because m(Ffiit(/)) = 0), 

where NS stands for Navier-Stokes. The correspondent continuum equations 
are 

^ = m(Fo(/;,)) + KnmiFoiA^l + ^l* )). (110) 

Here, the first term includes non-dissipative terms (the Euler ones) of the 
Navier-Stokes equations, and the second term includes both the dissipative 
terms of the Navier-Stokes equations and the filtering terms. Let us collect 
all the classical hydrodynamic terms together: 

* The term — / gives zero input in these Lie brackets for any linear operator B. 
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^""^"'^^ - '-KnJv^FMf)] (111) 



NS terms 



, dx ^ ^ dMiM^ dxr dx 

NS terms \ ''=1 ^i=0 

The NS terms here are the right hand sides of the Navier-Stokes equations 
for the BGK kinetics (with r = 2tcoi — 2Kn). Of course, is one of 

the tensor viscosity - tensor diffusivity models. Its exphcit form for the BGK 
equation and various similar model equations requires several quadratures: 

r=l i,j=0 ■' 

(for the Maxwell distributions that are just Gaussian integrals). 

Entropic stability condition for the filtered kinetic equations 

Instability of filtered equations is a well-known problem. It arises because 
the reverse filtering is an ill-posed operation, the balance between filter and 
reverse filter in (|75|l may be destroyed by any approximation, as well as a 
perturbation may move the hydrodynamic field out of space of pre-filtered 
fields. (And the general filtered equations are applicable for sure in that space 
only) 

Analysis of entropy production is the first tool for stability check. This is a 
main thermodynamic realization of the Lyapunov functions method (invented 
in physics before Lyapunov). 

The filtration term Ffmif) (|108|l in the filtered BGK equation (|HJ5|I does 
not produce the Boltzmann (i.e. macroscopic) entropy »S'(/m(j)), but is not 
conservative. In more details: 

1. (i?M5(/Xf))("^(^fiit(/:,(/)))) = 0, because m(Ffiit(/)) = 0; 

2. (%^(/))/,;„,(Ffiit(/;;(/))) = (i^M5(/M))(m(Ffiit(/;;(^)))) ^ 0; 

3. {DfS{f))f^^^^{FMf)) - iDfS{f))f^^jFMr^^f))) ^ 0, because Ffiit(/) 
depends on f^^j^ only; 

4. But for any field Ffiit(/) that depends on /j^^j-^-j only, if the conservativ- 
ity identity Ip!^ {DfS{f))f{Ffiit{f)) = is true even in a small vicinity 
of quasi-equilibria, then Fmtif) = 0. Hence, the non-trivial filter term 
Ffiit(/) cannot be conservative, the whole field F{f) = Fo{f) + Fmtif) is 
not conservative, and we cannot use the entropy production formula (|31|1 . 

Instead of H31|l we obtain 



(113) 
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The entropic stability condition for the filtered kinetic equations is: 

dSiM)/dt>0, i.e. Mzif ,Zif ),.^+,(Zif ,41*),.^ >0. (114) 
There exists a plenty of convenient sufficient conditions, for example, 



r] < Kn 



l(z\y.^z\^')/. I 



11,1 1m 



or rj < Kn^ 



^ Jm' Im'^m 



(115) 



The upper boundary for 77 that guaranties stability of the filtered equa- 
tions is proportional to Kn. For the Gaussian filter width A this means 
A = L^/2Ari ~ %/ Kn (where L is the characteristic macroscopic length) . This 
scaling, A/L ^ \J Kn, was discussed in [18] for moment kinetic equations be- 
cause different reasons: if Z\/L ^ \jKn then the Chapman-Enskog procedure 
is not applicable, and, moreover, the continuum description is probably not 
valid, because the filtering term with large coefficient r\ violates the conditions 
of hydrodynamic limit. This important remark gives the frame for 77 scaling, 
and (|114|l . (|115|l give the stability boundaries inside this scale. 



4 Errors of Models, £-trajectories and Stable Properties 
of Structurally Unstable Systems 

4.1 Phase flow, attractors and repellers 

Phase flow 

In this section, we return from kinetic systems to general dynamical systems, 
and lose such specific tools as entropy and quasi-equilibrium. Topological dy- 
namics gives us a natural language for general discussion of limit behavior and 
relaxation of general dynamical systems [109]. We discuss a general dynami- 
cal system as a semigroup of homeomorphisms (phase flow transformations) : 
0{t, x) is the result of shifting point x in time t. 

Let the phase space X be a compact metric space with the metrics p, 

■.[0,oo[xX ^ X (116) 

be a continuous mapping for any t > 0; let mapping 0{t, ■) : X X he 
homeomorphism of X into subset of X and let these homeomorphisms form 
monoparametric semigroup: 

0(0, •) = id, 0{t, 0{t', x)) ^ 0{t + t', x) (117) 

for any t,t' >0,x e X. 

Below we call the semigroup of mappings 0{t, •) a semiflow of homeomor- 
phisms (or, for short, semiflow), or simply system (|116|l . We assume that the 
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continuous map 0(t, x) is continued to negative time t as far as it is possible 
with preservation of the semigroup property H117|) . For phase flow we use also 
notations 0t and Ot{x). For any given x € X, x-motion is a function of time 
0(t, x), a;-motion is the whole motion if the function is defined on the whole 
axis i g] — oo, oo[. The image of a;-motion is the x-trajectory. 

Attractors and repellers 

First of all, for the description of limit behaviour we need a notion of an 
w-limit set. 

A point p X is called u- (a-)- limit point of the cc-motion (correspondingly 
of the whole a;-motion), if there is such a sequence tn oo (tn — oo) that 
0{tn, x) p as n ^ oo. The totality of all lu- (Q!-)-limit points of a;-motion is 
called its uj- {a-)-limit set and is denoted by (a(x)). 

A set W G X is called invariant set, if, for any x € W , the x-motion is 
whole and the whole x-trajectory belongs to W . 

The sets lij{x), a{x) (the last in the case when x-motion is whole) are 
nonempty, closed, connected, and invariant. 

The set of all w-limit points of the system ljq = \_]^^x ^{^) is nonempty 
and invariant, but may be disconnected and not closed. The sets uj{x) might 
be considered as attractors, and the sets a{x) as repellers (attractors for t 
—oo). The system of these sets represents all limit behaviours of the phase 
flow. 

Perhaps, the most constructive idea of attractor definition combines pure 
topological (metric) and measure points of view. A weak attractor [113] is a 
closed (invariant) set A such that the set B{A) = {x | llj{x) C A} (a basin 
of attraction) has strictly positive measure. A Milnor attractor [112] is such 
a weak attractor that there is no strictly smaller closed A' ^ A so that B{A) 
coincides with B{A') up to a set of measure zero. If A is a Milnor attractor 
and for any closed invariant proper subset A' ^ A the set B{A') has zero 
measure, then we say that A is a minimal Milnor attractor. 

Below in this section we follow a purely topological (metric) point of view, 
but keep in mind that its combination with measure-based ideas create a 
richer theory. 

The dream of applied dynamics 

Now we can formulate the "dream of applied dynamics." There is such a finite 
number of invariant sets Ai, . . . A^ that: 

• Any attractor or repeller is one of the Ai; 

• The following relation between sets Ai, . . . An is acyclic: Ai >: Aj if there 
exists such x that a(x) — Ai and uj(x) — Aj] 

• The system Ai, . . . An with the preorder Ai >: Aj does not change qual- 
itatively under sufficiently small perturbations of the dynamical system: 
all the picture can be restored by a map that is close to id. 
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For generic two-dimensional systems this dream is the reahty: there is a finite 
number of fixed points and closed orbits such that any motion goes to one of 
them at t ^ oo, and to another one at t ^ — oo for a whole motion. 

The multidimensional analogues of generic two-dimensional systems are 
the Morsc-Smalc systems. For them all attractors and rcpcllcrs arc fixed 
points or closed orbits. The relation Ai >: Aj for them is the Smale order. 
But the class of the Morse-Smale systems is too narrow: there are many 
systems with more complicated attractors, and some of these systems are 
structurally stable and do not change qualitatively after sufficiently small 
perturbations.^ It is necessary to take into account that typically some of mo- 
tions have smaller attractors (for example, in Ai exists a dense set of closed 
orbits), and lo{x) = Aj not for all, but for almost all x. Finally, the "dream 
of applied dynamics" was destroyed by S. Smale [20]. He demonstrated that 
"structurally stable systems are not dense." It means that even the last item 
of this dream contradicts the multidimensional reality. 

4.2 Metric coarse-graining by e- motions 

e-motions 

The observable picture must be structurally stable. Any real system exists 
under the permanent perturbing influence of the external world. It is hardly 
possible to construct a model taking into account all such perturbations. Be- 
sides that, the model describes the internal properties of the system only 
approximately. The discrepancy between the real system and the model aris- 
ing from these two circumstances is different for different models. So, for the 
systems of celestial mechanics it can be done very small. Quite the contrary, 
for chemical engineering this discrepancy can be if not too large but not such 
small to be neglected. Structurally unstable features or phase portrait should 
be destroyed by such an unpredictable divergence of the model and reality. 
The perturbations "conceal" some fine details of dynamics, therefore these 
details become irrelevant to analysis of real systems. 

There are two traditional approaches to the consideration of perturbed 
motions. One of them is to investigate the motion in the presence of small 
sustained perturbations [119,120,122], the other is the study of fluctuations 
under the influence of small stochastic perturbations [32,33]. In this section, 
we join mainly the first direction. 

A small unpredictable discrepancy between the real system and the dy- 
namical model can be simulated by periodical "fattening." For a set A C X 
its £-fattening is the set 



Ag = {x \ p{x, y) < e for all y € A}. 



(118) 
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Review of modern dynamics is presented in [110, 111] 
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Fig. 12. An (e, r)-motion 0°{to + t) {t G [0, r]) in the e-tube near a genuine motion 
&{t,0^ (to)) (t G [0,r]) duration r (a), and an (e,r)-motion 0^{t) with fragments 
of genuine motions duration r in the e-tube near 0^{t) (b). 



Instead of one x-motion we consider motion of a set, A{t) — 0tA, and combine 
this motion with periodical e-fattening for a given period r. For superposition 
of Or with e-fattening we use the notation 0^: 

@IA = {OrA), (119) 

For t e [riT, {n+l)T[ We need to generahze this definition for t e [nr, (n+l)T[: 

@IA = 0t-nr{{&'rrA). (120) 

Analysis of these motions of sets gives us the information about dynamics 
with £-uncertainty in model. Single-point sets are natural initial conditions 
for such motions. 

One can call this coarse-graining the metric coarse-graining, and the Eren- 
fest's coarse-graining for dynamics of distribution function might be called 
the measure coarse-graining. The concept of metric-measure spaces (mm- 
spaces [123]) gives the natural framework for analysis of various sorts of 
coarse- graining. 

It is convenient to introduce individual e-motions. A function of time 0'^{t) 
with values in X, defined at t > 0, is called (e, a:)-motion (e > 0), if 0^{O) — x 
and for any to > 0, t e [0, r] the inequality piO^to + t),0{t,e%to))) < e 
holds. In other words, if for an arbitrary point O'^ito) one considers its motion 
due to phase flow of dynamical system, this motion will diverge 0^{t{) -f t) 
from no more than at e for t e [0, r]. Here [0, r] is a certain interval of time, its 
length T is not very important (it is important that it is fixed), because later 
we shall consider the case e ^ 0. For a given r we shall call the (e, x)-motion 
(e, X, r)-motion when reference to r is necessary. On any interval [io, + ''"] an 
(e, x, r)-motion deviates from a genuine motion not further than on distance 
e if these motions coincide at time moment to ^Fig. 112^ 1). If a genuine motion 
starts from a point of an (e, x, T)-trajectory, it remains in the e-tubc near that 
(e,r)-motion during time r (Fig. ^Jd). 
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Limit sets of s -motions 

Let us study the limit behaviour of the coarse-grained trajectories ®fA, and 
than take the Hmit £ ^ 0. For systems with comphcated dynamics, this Umit 
may differ significantly from the limit behaviour of the original system for 
£ = 0. This effect of the perturbation influence in the zero limit is a "smile of 
a Cheshire cat:" the cat tends to disappear, leaving only its smile hanging in 
the air. 

For any 0'^{t) the w-limit set u){&^) is the set of all limit points of 0'^{t) 
at t ^ oo. For any x G X a set oj^{x) is a totality of all w-limit points of all 
(£, a;)-motions: 

0=(O)=x 

For £ ^ we obtain the set 

ij°{x) = Pi uj'{x). 

E>Q 

Firstly, it is necessary to notice that (jJ^{x) does not always tend to w{x) as 
£ 0: the set w°(a;) may not coincide with lo{x, k). 

The sets lo'^(x) arc closed and invariant. Let x G Then for any £ > 

there exists periodical {e, x)-motion (This is a version of Anosov's C°-closing 
lemma [111,114]). 

The function oj^{x) is upper semicontinuous. It means that for any se- 
quence Xi ^ X all limit points of all sequences e u^{xi) belong to u)^{x). 

In order to study the limit behaviour for all initial conditions, let us join 
all a;°(a;): 

a;0 = U = IJ fl '^'(^) = f] U '^'(^)- (^^l) 

xex xex s>o e>Oxex 

The set is closed and invariant, li y G lu'^ then y € oj^{y). If Q C co^ and Q 
is connected, then Q C for any y G Q7 

The £-motions were studied earlier in differential dynamics, in connection 
with the theory of Anosov about £-trajcctorics and its applications [114 118]. 
For systems with hyperbolic attr actors an important e -motion shadowing 
property was discovered: for a given 77 > and sufficiently small £ > for 
any £-motion 0^{t) there exists a motion of the non-perturbed system 0{t, x) 
that belongs to rj - neighborhood of 0^{t): 

p{0'{4>{t)),0{t,x)) <r,, 

for t > and some monotonous transformation of time (j){t) {t — 4'{t) — 0{et)). 
The sufficiently small coarse-graining changes nothing in dynamics of systems 
with this shadowing property, because any £-motion could be approximated 
uniformly by genuine motions on the whole semiaxis t G [0, oo[. 

^ For all proofs here and below in this section we address to [22,23]. 
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Preorder and equivalence generated by dynamics 

Let xi,X2 G X. Let us say xi X2 if for any e > there exists such a 
(e, Xi)-motion 0^{t) (6*^(0) = xi) that 0'^{to) = X2 for some to > 0. 

Let xi,X2 G X. Say that points xi and X2 are 0-equivalent (denotation 
xi ~e X2), if xi >^0 X2 and a;2 xi. 

The relation is a closed ©-invariant preorder relation on X: 

• It is reflexive: x x for all x G X; 

• It is transitive: xi ^0 X2 and X2 ^0 X3 implies Xi ^0 x^; 

• The set of pairs {xi,X2), for which xi ^0 X2 is closed in X] 

• If Xi ^0 X2 then 0{t, xi) ^0 0{t, X2) for any t > 0. 

The necessary and sufficient conditions for the preorder ^0 relation are as 
follows: xi ^0 X2 if and only if either X2 G ll>'^{xi) or X2 = 0{t,xi) for some 
t > 0. Therefore, 

u;"(x) = {yet^° I x^ej/} (122) 
The relation ^0 is a closed ©-invariant equivalence relation: 

• The set of pairs {xi,X2), for which xi ^0 X2 is closed in X; 

• If xi ~ X2 and xi ^ X2-, then x\- and a;2-motions are whole and ^0 0{t, X2) 
for any t s] — 00, 00 [ 0{t, xi). 

If xi ^ X2, then xi ~e X2 if and only if ^"(xi) = ti;*'(x2) , xi G a;'^(xi), and 

X2 e W°(X2). 

Compare with [32], where analogous theorems are proved for relations 
defined by action functional for randomly perturbed dynamics. 

The coarsened phase portrait 

We present the results about the coarsened phase portrait as a series of the- 
orems. 

Let us remind, that topological space is called totally disconnected if there 
exist a base of topology, consisting of sets which are simultaneously open 
and closed. Simple examples of such spaces are discrete space and Cantor's 
discontinuum. In a totally disconnected space all subsets with more than one 
element are disconnected. Due to the following theorem, in the coarsened 
phase portrait we have a totally disconnected space instead of finite set of 
attractors mentioned in the naive dream of applied dynamics. 

Theorem 1. The quotient space uP j ^0 is compact and totally disconnected. 

The space w"/ ^0 with the factor-relation ^0 on it is the generalized 
Smale diagram with the generalized Smale order on it [22,23]. 

Attractors and basins of attraction are the most important parts of a 
phase portrait. Because of p22|l . all attractors are saturated downwards. The 
set F C is saturated downwards, if for any y gY, 
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{x e LJ° \ y >Z0 x} C Y. 

Every saturated downwards subset in w*' is saturated also for the equivalence 
relation ~e and includes with any x all equivalent points. The following the- 
orem states that coarsened attractors Y (open in uj'^ saturated downwards 
subsets of uj'^) have open coarsened basins of attraction S°(y). 

Theorem 2. Let Y C lu" be open (in w^j saturated downwards set. Then the 
set B°{Y) = {xe X \ uj°{x) C Y} is open in X. 

There is a natural expectation that w-limit sets can change by jumps on 
boundaries of basins of attraction only. For the coarsened phase portrait it is 
true. 

Theorem 3. The set B of all points of discontinuity of the function Ld'^{x) is 
the subset of first category in X If x £ B then 0{t,x) G B for all t when 
0{t, x) is defined. 

Theorem 4. Let x E X be a point of discontinuity of the function uj^{x). 
Then there is such open in lo^ saturated downwards set W that x £ dB^(W). 

The function w'^(x) is upper semicontinuous, hence, in any point x* of 
its discontinuity the lower semicontinuity is broken: there exist a point y* e 
a number r] > 0, and a sequence Xi x* such that 

p{y* , y) > V for any y £ Lj^{xi) and all i. 

The classical Smale order for hyperbolic systems was defined on a finite 
totality Ai, . . .An of basic sets that are closed, invariant, and transitive (i.e. 
containing a dense orbit). Ai >- Aj if there exists such x £ X that x-trajectory 
is whole, a(x) C Ai, ui(x) C Aj. Such special trajectories exist in the general 
case of coarsened dynamical system also. 

Theorem 5. Let X be connected, be disconnected. Then there is such x £ 
X that x-motion is whole and x ^ LlP . There is also such partition of lo^ that 

tj" = VKi U W2, Vrn W^2 = 0, af{x) C Wi, Lj°{x) C W2, 

and Wi^2 o-fG open and, at the same time, closed subsets of LlP (it means that 
Wi^2 preimages of open-closed subsets of the quotient space llP j ^0 ). 

This theorem can be applied, by descent, to connected closures of coarsened 
basins of attraction B'^{Y) (see Theorem 

Theorems give us the picture of coarsened phase portrait of a general 
dynamical system, and this portrait is qualitatively close to phase portraits of 
structurally stable systems: rough 2D systems, the Morse-Smale systems and 
the hyperbolic Smale systems. For proofs and some applications we address 
to [22,23]. 

* A set of first category, or a meagre set is a countable union of nowhere dense 
sets. In a complete metric space a complement of a meagre set is dense (the Baire 
theorem). 
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Stability of the coarsened phase portrait under smooth perturbations of vector 
fields 

In order to analyze stability of this picture under the perturbation of the 

vector field (or the difFeomorphism, for discrete time dynamics) it is necessary 
to introduce C'^ £-fattening in the space of smooth vector fields instead of 
periodic £-fattening of phase points. We shall discuss a C'^-smooth dynamical 
system 6* on a compact C""-manifold M(0 < fc < m). Let 0t be the semigroup 
of phase flow transformations (shifts in time t > 0) and Ue{0) be the set 
of phase flows that corresponds to a closed £-neighborhood of system 0^ in 
the C'^-norm topology of vector fields. The positive semi-trajectory of phase 
point a; is a set 0(x) = {0t{x):t > 0}. The C*^ e-fattened semi-trajectory is 
0^{x) = U<f e!7e(e) ^{x)- Let us take this set with all limits for t — > oo. It is 

the closure 0^{x). After that, let us take the limit e ^ Q: Px = nE>o^^(^) 
(it is an analogue of 0{x) Ua;o(a;) from our previous consideration for general 
dynamical systems). Following [21] let us call this set Px a prolongation of the 
semi-trajectory 0{x). 

A trajectory of a dynamical system is said to be stable under constantly- 
acting perturbations if its prolongation is equal to its closure: Px = 0{x) 

For a given dynamical system let L{0) denote the miion of all trajectories 
that are stable in the above sense and let Li be the set of all dynamical systems 
for which L{0) is dense in phase space: L{0) = M. All structurally stable 
systems belong to Li. The main result of [21] is as follows: 

Theorem 6. The set Li is a dense Gg in the space of C'^ dynamical systems 
with the C'^ norm.^ 

So, for almost all smooth dynamical systems almost all trajectories are 
stable under smooth constantly-acting perturbations: this type of stability is 
typical. 

5 Conclusion 

Two basic ideas of coarse-graining are presented. In the Ehrenfests' inspired 
approach the dynamics of distributions with averaging is studied. In the metric 
approach the starting point of analysis is dynamics of sets with periodical e- 
fattening. 

The main question of the Ehrenfests' coarse-graining is: where should we 
take the coarse-graining time r? There are two limit cases: r — > and r ^ oo 
(physically, oo here means the time that exceeds all microscopic time scales). 
The first limit, r ^ 0, returns us to the quasi-equilibrium approximation. The 

^ In a topological space a Gg set is a countable intersection of open sets. A com- 
plement of a dense Gs set is a countable union of nowhere dense sets. It is a set 
of first category, or a meagre set. 
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second limit is, in some sense, exact (if it exists). Some preliminary steps in 
the study of this limit are made in [4,74,75]. On this way, the question about 
proper values of the Prandtl number, as well, as many other similar questions 
about kinetic coefficients, has to be solved. 

The constructed family of chains between conservative (with the Karlin- 
Succi involution) and maximally dissipative (with Ehrenfests' projection) ones 
give us a possibility to model hydrodynamic systems with various dissipation 
(viscosity) coefficients that are decoupled with time steps. The collision inte- 
gral is successfully substituted by combinations of the involution and projec- 
tion. 

The direct descendant of the Ehrenfests' coarse-graining, the kinetic ap- 
proach to filtering of continuum equations, seems to be promising and phys- 
ically reasonable: if we need to include the small eddies energy into internal 
energy, let us lift the continuum mechanics to kinetics where all the energies 
live together, make there the necessary filtering, and then come back. Two 
main questions: when the obtained filtered continuum mechanics is stable, and 
when there is way back from filtered kinetics to continuum mechanics, have 
unexpectedly the similar answer: the filter width A should be proportional to 
the square root of the Knudsen number. The coefficient of this proportionality 
is calculated from the cntropic stability conditions. 

The metric coarse-graining by £-motions in the limit £ ^ gives the stable 
picture with the totally disconnected system of basic sets that form sources 
and sinks structure in the phase space. Everything looks nice, but now we 
need algorithms for effective computation and representation of the coarsened 
phase portrait even in modest dimensions 3-5 (for discrete time systems in 
dimensions 2-4). 

It is necessary to build a bridge between theoretical topological picture 
and applied computations. In some sense, it is the main problem of modern 
theory of dynamical systems to develop language and tools for constructive 
analysis of arbitrary dynamics. Of course, the pure topological point of view 
is unsufficient, and we need an interplay between measure and topology of 
dynamical systems, perhaps, with inclusion of some physical and probabilistic 
ideas. 

Acknowledgement. A couple of years ago, Wm. Hoover asked me to explain clearly 
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tempt to answer. I am grateful to H.C. Ottinger, and L. Tatarinova for scientific 

discussion and collaboration. Long joint work with I.V. Karlin was very important 
for my understanding of the Ehrenfests' coarse-graining and lattice Boltzmann mod- 
els. 



Basic Types of Coarse- Graining 



55 



References 

1. P. Ehrenfest, T. Ehrenfest-Afanasyeva, The Conceptual Foundations of the 
Statistical Approach in Mechanics, In: Mechanics Enziklopddie der Mathe- 
matischen Wissenschaften, Vol. 4., Leipzig, 1911. (Reprinted: P. Ehrenfest, 
T. Ehrenfest-Afanasyeva, The Conceptual Foundations of the Statistical Ap- 
proach in Mechanics, Dover Phoneix, 2002.) 

2. H. Grabert, Projection operator techniques in nonequilibrium statistical me- 
chanics. Springer Verlag, Berlin, 1982. 

3. A.N. Gorban, I.V. Karlin, A.Yu. Zinovyev, Constructive methods of invari- 
ant manifolds for kinetic problems, Phys. Reports 396, 4-6 (2004), 197-403. 
Preprint online: |http://ajxiv.org/abs/cond-mat/0311017| 

4. A.N. Gorban, I.V. Karlin, Invariant manifolds for physical and chemical ki- 
netics, Lect. Notes Phys., Vol. 660, Springer, Berlin, Heidelberg, New York, 
2005. 

5. A.N. Gorban, I.V. Karlin, P. Ilg, and H.C. Ottinger, Corrections and enhance- 
ments of quasi-equilibrium states, J. Non-Newtonian Fluid Mech. 96 (2001), 
203-219. 

6. K.G. Wilson, and J. Kogut. The renormalization group and the e-expansion, 
Phys. Reports 12C (1974), 75-200. 

7. O. Pashko, Y. Oono, The Boltzmann equation is a renormalization group equa- 
tion. Int. J. Mod. Phys. B 14 (2000), 555-561. 

8. Y. Hatta, T. Kunihiro, Renormalization group method applied to kinetic equa- 
tions: roles of initial values and time. Annals Phys. 298 (2002), 24-57. 

9. I.e. Kevrekidis, C.W. Gear, J.M. Hyman, P.G. Kevrekidis, O. Runborg, C. 
Theodoropoulos, Equation- free, coarse-grained multiscale computation: en- 
abling microscopic simulators to perform system-level analysis. Comm. Math. 
Sci. 1 4 (2003), 715-762. 

10. A.J. Chorin, O.H. Hald, R. Kupferman, Optimal prediction with memory, 
Physica D 166 (2002), 239-257. 

11. A.N. Gorban, I.V. Karlin, H.C. Ottinger, and L.L. Tatarinova, Ehren- 
fests' argument extended to a formalism of nonequilibrium thermodynamics, 
Phys. Rev. E 63 (2001), 066124. 

12. A.N. Gorban, I.V. Karlin, Uniqueness of thermodynamic projector and kinetic 
basis of molecular individualism, Physica A 336, 3-4 (2004), 391-432. 

13. J. Leray, Sur les movements dun fluide visqueux remplaissant lespace. Acta 
Mathematica, 63 (1934), 193-248. 

14. J. Smagorinsky, General Circulation Experiments with the Primitive Equa- 
tions: I. The Basic Equations, Mon. Weather Rev. 91 (1963), 99-164. 

15. M. Germano, Turbulence: the filtering approach, J. Fluid Mech. 238 (1992), 
325-336. 

16. D. Carati, G.S. Winckelmans, H. Jeanmart, On the modelling of the subgrid- 
scale and filtered-scale stress tensors in large-eddy simulation, J. Fluid Mech., 
441 (2001), 119-138. 

17. M. Lesieur, O. Metais, P. Comte, Large-Eddy Simulations of Turbulence, Cam- 
bridge University Press, 2005. 

18. S. Ansumali, I.V. Karlin, S. Succi, Kinetic Theory of Turbulence Model- 
ing: Smallness Parameter, Scaling and Microscopic Derivation of Smagorinsky 
Model, Physica A, 338 (2004), 379-394. 



56 Alexander N. Gorban 



19. S. Succi, The lattice Boltzmann equation for fluid dynamics and beyond, 
Clarendon Press, Oxford, 2001. 

20. S. Smale, Structurally stable systems are not dense, Amer. J. Math. 88 (1966), 
491-496. 

21. V.A. Dobrynskii, A.N. Sharkovskii, Genericity of the dynamical systems almost 
all orbits of which are stable under sustained perturbations, Soviet Math. Dokl. 
14 (1973), 997-1000. 

22. A.N. Gorban, Slow relaxations and bifurcations of omega-limit sets of dy- 
namical systems, PhD Thesis in Physics & Math. (Differential Equations & 
Math.Phys), Kuibyshev, Russia, 1980. 

23. A.N. Gorban, Singularities of Transition Processes in Dy- 
namical Systems: Qualitative Theory of Critical Delays, Elec- 
tronic Journal of Differential Equations, Monograph 05, 2004. 
fhttp:/ /ejde. math. txstate.edu/Monographs/05/abstr. html (Includes English 
translation of [22].) 

24. B.A. Huberman, W.F. Wolff, Finite precision and transient behavior, Phys. 
Rev. A 32, 6 (1985), 3768-3770. 

25. C. Beck, G. Roepsorff, Effects of phase space discretization on the long-time 
behavior of dynamical systems, Phystca D 25 (1987), 173-180. 

26. C. Grebogi, E. Ott, J. A. Yorke, Roundoff-induced periodicity and the correla- 
tion dimension of chaotic attractors, Phys. Rev. A 38, 7 (1988), 3688-3692. 

27. P. Diamond, P. Kloeden, A. Pokrovskii, A. Vladimirov, Collapsing effect in 
numerical simulation of a class of chaotic dynamical systems and random map- 
pings with a single attracting centre, Physica D 86 (1995), 559-571. 

28. L. Longa, E.M.F. Curado, A. Oliveira, Rounoff-induced coalescence of chaotic 
trajectories, Phys. Rev. E 54, 3 (1996), R2201-R2204. 

29. P.-M. Binder, J.C. Idrobo, Invertibility of dynamical systems in granular phase 
space, Phys. Rev. E 58, 6 (1998), 7987-7989. 

30. C. Dellago, Wm. G. Hoover, Finite-precision stationary states at and away 
from equilibrium, Phys. Rev. E G2, 5 (2000), 6275-6281. 

31. B. BoUobas, Random Graphs (Cambridge Studies in Advanced Mathematics), 
Cambridge University Press, 2001. 

32. M.I. Freidlin, A.D. Wentzell, Random Perturbations of Dynamical Systems 
(Grundlehren der mathematischen Wissenschaften, V.260), Springer- Verlag 
New York, Berlin, Heidelberg, 1998. 

33. L. Arnold, Random Dynamical Systems, Springer Monographs in Mathematics, 
16, Springer, Berlin, Heidelberg, New York, 2002. 

34. A.N. Gorban, Equilibrium encircling. Equations of chemical kinetics and their 
thermodynamic analysis, Nauka, Novosibirsk, 1984. 

35. A.N. Gorban, V.I. Bykov, G.S. Yablonskii, Essays on chemical relaxation, 
Nauka, Novosibirsk, 1986. 

36. G.S.Yablonskii, V.I. Bykov, A.N. Gorban, and V.I.Elokhin, Kinetic Models of 
Catalytic Reactions (Series "Comprehensive Chemical Kinetics," V.32, ed. by 
R.G. Compton), Elsevier, Amsterdam, 1991, 

37. Y.B. Zeldovich, Proof of the Uniqueness of the Solution of the Equations of 
the Law of Mass Action, In: Selected Works of Yakov Borisovich Zeldovich, 
Vol. 1, J. P. Ostriker (Ed.), Princeton University Press, Princeton, USA, 1996, 
144-148. 



Basic Types of Coarse-Graining 



57 



38. Bhatnagar, P.L., Gross, E.P., Krook, M., A model for collision processes in 
gases. 1. Small amplitude processes in charged and neutral one-component 
systems, Phys. Rev., 94, 3 (1954), 511 525. 

39. Gorban, A.N., Karlin, I.V., General approach to constructing models of the 
Boltzmann equation, Physica A, 206 (1994), 401-420. 

40. D. Hilbert, Begriindung der kinetischen Gastheorie, Math. Annalen 72 (1912), 
562 577. 

41. D. Ruelle, Smooth Dynamics and New Theoretical Ideas in Nonequilibrium 
Statistical Mechanics, J. Stat. Phys. 95 (1-2) (1999), 393-468. 

42. S. KuUback, Information theory and statistics, Wiley, New York, 1959. 

43. A.N. Gorban, I.V. Karlin, Family of additive entropy functions out of thermo- 
dynamic limit, Phys. Rev. E 67 (2003), 016104. 

44. P. Gorban, Monotonically equivalent entropies and solution of additivity equa- 
tion, Physica A 328 (2003), 380-390. 

45. S. Abe, Y. Okamoto (Eds.), Nonextensive statistical mechanics and its appli- 
cations. Springer, Heidelberg, 2001. 

46. B.M. Boghosian, P.J. Love, P.V. Coveney, I.V. Karlin, S. Sued, J. Yepez, 
Galilean-invariant lattice-Boltzmann models with H theorem, Phys. Rev. E 
68, 2 (2003), 025103(R) 

47. G.W. Gibbs, Elementary Principles of Statistical Mechanics, Dover, 1960. 

48. E.T. Jaynes, Information theory and statistical mechanics, in: Statistical 
Physics. Brandeis Lectures, V.3, K. W. Ford, ed.. New York: Benjamin, 1963, 
pp. 160-185. 

49. D. Zubarev, V. Morozov, G. Ropke, Statistical mechanics of nonequilibrium 
processes, Akademie Verlag, Berlin, V.l, 1996, V.2, 1997. 

50. H. Grad, On the kinetic theory of rarefied gases. Comm. Pure and Appl. Math. 
2 4, (1949), 331 407. 

51. J.T. Alvarez-Romero, L.S. Garcia-Colm, The foundations of informational sta- 
tistical thermodynamics revisited, Physica A 232, 1-2 (1996), 207-228 

52. R.E. Nettleton, E.S. Freidkin, Nonlinear reciprocity and the maximum entropy 
formalism, Physica A 158, 2 (1989), 672-690. 

53. N.N. Orlov, L.I. Rozonoer, The macrodynamics of open systems and the vari- 
ational principle of the local potential, J. Franklin Inst. 318 (1984), 283-314 
and 315-347. 

54. A.M. Kogan, L.I. Rozonoer, On the macroscopic description of kinetic pro- 
cesses, Dokl. AN SSSR 158, 3 (1964), 566-569. 

55. A.M. Kogan, Derivation of Grad-type equations and study of their properties 
by the method of entropy maximization, Prikl. Matem. Mech. 29 (1) (1965), 
122-133. 

56. L.I. Rozonoer, Thermodynamics of nonequilibrium processes far from equi- 
librium, in: Thermodynamics and Kinetics of Biological Processes (Nauka, 
Moscow, 1980), 169-186. 

57. J. Karkheck, G. Stell, Maximization of entropy, kinetic equations, and irre- 
versible thermodynamics Phys. Rev. A 25, 6 (1984), 3302-3327. 

58. N.N. Bugaenko, A.N. Gorban, I.V. Karlin, Universal Expansion of the Triplet 
Distribution Function, Teoret. i Matem. Fisika 88, 3 (1991), 430-441 (TransL: 
Theoret. Math. Phys. (1992), 977-985). 

59. A.N. Gorban, I.V. Karlin, Quasi-equilibrium approximation and non-standard 
expansions in the theory of the Boltzmann kinetic equation, in: "Mathematical 



58 Alexander N. Gorban 



Modelling in Biology and Chemistry. New Approaches", ed. R. G. Khlebopros, 
Nauka, Novosibirsk, P. 69-117 (1991). [in Russian] 

60. A.N. Gorban, I.V. Karlin, Quasi-equilibrium closure hierarchies for the Boltz- 
mann equation, Physica A 360, 2 (2006), 325-364. (Includes translation of the 
first part of [59]). 

61. C.D. Levermore, Moment Closure Hierarchies for Kinetic Theories, J. Stat. 
Phys. 83 (1996), 1021-1065. 

62. R. Balian, Y. Alhassid, H. Reinhardt, Dissipation in many-body systems: A 
geometric approach based on information theory, Phys. Reports 131, 1 (1986), 
1-146. 

63. P. Degond, C. Ringhofer, Quantum moment hydrodynamics and the entropy 
principle, J. Stat. Phys. 112 (2003), 587-627. 

64. P. Ilg, I.V. Karlin, H.C. Ottinger, Canonical distribution functions in polymer 
dynamics: I. Dilute solutions of flexible polymers, Phystca A 315 (2002), 367- 
385. 

65. P. Ilg, I.V. Karlin, M. Kroger, H.C. Ottinger, Canonical distribution functions 
in polymer dynamics: II Liquid-crystalline polymers, Physica A 319 (2003), 
134-150. 

66. P. Ilg, M. Kroger, Magnetization dynamics, rheology, and an effective descrip- 
tion of ferromagnetic units in dilute suspension, Phys. Rev. E 66 (2002) 021501. 
Erratum, Phys. Rev. E 67 (2003), 049901(E). 

67. P. Ilg, I.V. Karlin, Combined micro-macro integration scheme from 
an invariance principle: application to ferrofluid dynamics, J. Non- 
Newtonian Fluid Mech. 120, 1-3 (2004), 33-40 2004. Ppeprint online: 
http : // arxiv . org/ abs /cond-mat /040 1383 

68. B. Robertson, Equations of motion in nonequilibrium statistical mechanics, 
Phys. Rev. 144 (1966), 151-161. 

69. P.J. Morrison, Hamiltonian description of the ideal fluid. Rev. Mod. Phys. 70 
(1998), 467-521. 

70. E. Wigner, On the quantum correction for thermodynamic equilibrium, Phys. 
Rev. 40 (1932), 749-759. 

71. A.O. Caldeira, A.J. Leggett, Influence of damping on quantum interference: 
An exactly soluble model, Phys. Rev. A 31 (1985), 1059-1066. 

72. A.N. Gorban, I.V. Karlin, Reconstruction lemma and fluctuation-dissipation 
theorem, Revista Mexicana de Fisica 48, Supl. 1 (2002), 238-242. 

73. A.N. Gorban, I.V. Karlin, Macroscopic dynamics through coarse-graining: A 
solvable example, Phys. Rev. E 56 (2002), 026116. 

74. A.N. Gorban, I.V. Karlin, Geometry of irreversibility, in: Recent Developments 
in Mathematical and Experimental Physics, Vol. C, Ed. F. Uribe, Kluwer, 
Dordrecht, 2002, 19-43. 

75. A.N. Gorban, I.V. Karlin, Geometry of irreversibility: The film of nonequi- 
librium states. Preprint IHES/P/03/57, Institut des Hautes Etudes Sci- 
entifiques in Bures-sur-Yvette (France), 2003. 69 p. Preprint on-line: 
|http://arXiv.org/abs/c ond-mat /030833 1 

76. I.V. Karlin, L.L. Tatarinova, A.N. Gorban, H.C. Ottinger, Irreversibility in the 
short memory approximation, Physica A 327, 3-4 (2003), 399-424. 

77. J.L. Lebowitz, Statistical Mechanics: A Selective Review of Two Central Issues, 
Rev. Mod. Phys. 71 (1999), S346. 

78. S. Goldstein, J.L. Lebowitz, On the (Boltzmann) Entropy of Nonequilibrium 
Systems, Physica D 193 (2004), 53-66. 



Basic Types of Coarse-Graining 



59 



79. Chapman, S., Cowling, T., Mathematical theory of non-uniform gases. Third 
edition, Cambridge University Press, Cambridge, 1970. 

80. C. Cercignani, The Boltzmanri equation and its applications. Springer, New 
York, 1988. 

81. L. Mieussens, H. Struchtrup, Numerical Comparison of Bhatnagar-Gross- 
Krook models with proper Prandtl number, Phys. Fluids 16, 4 (2004), 2797- 
2813. 

82. R.M. Lewis, A unifying principle in statistical mechanics, J. Math. Phys. 8 
(1967), 1448-1460. 

83. Lyapunov A.M., The general problem of the stability of motion, Taylor & 
Francis, London, 1992. 

84. L.B. Ryashko, E.E. Shnol, On exponentially attracting invariant manifolds of 
ODEs, Nonlinearity 16 (2003), 147-160. 

85. C. Foias, M.S. Jolly, I.G. Kevrekidis, G.R. Sell, E.S. Titi, On the computation 
of inertial manifolds, Phys. Lett. A 131, 7-8 (1988), 433-436. 

86. Y. Sone, Kinetic theory and fluid dynamics, Birkhauser, Boston, 2002. 

87. C.W. Gear, T.J. Kaper, LG. Kevrekidis, A. Zagaris, Projecting to a slow mani- 
fold: singularly perturbed systems and legacy codes, SIAM J. Appl. Dynamical 
Systems 4, 3 (2005), 711-732. 

88. F. Higuera, S. Succi, R. Benzi, Lattice gas-dynamics with enhanced collisions, 
Europhys. Lett. 9 (1989), 345-349. 

89. LV. Karlin, A.N. Gorban, S. Succi, V. Boffi, V. Maximum entropy principle 
for lattice kinetic equations, Phys. Rev. Lett. 81 (1998), 6-9. 

90. H. Chen, S. Chen, W. Matthaeus, Recovery of the Navier-Stokes equation 
using a lattice-gas Boltzmann Method Phys. Rev. A 45 (1992), R5339-R5342. 

91. Y.H. Qian, D. d'Humieres, P. Lallemand, Lattice BGK models for Navier- 
Stokes equation, Europhys. Lett. 17, (1992), 479-484. 

92. S. Succi, I.V. Karlin, H. Chen, Role of the H theorem in lattice Boltzmann 
hydrodynamic simulations, Rev. Mod. Phys. 74 (2002), 1203-1220. 

93. LV. Kaxlin, A. Ferrante, H.C. Ottinger, Perfect entropy functions of the Lattice 
Boltzmann method, Europhys. Lett. 47, 182-188 (1999). 

94. S. Ansumali, LV. Karlin, Entropy function approach to the lattice Boltzmann 
method, J. Stat. Phys. 107 291-308 (2002). 

95. R. Cools, An encyclopaedia of cubature formulas, J. of Complexity, Volume 
19, Issue 3, June 2003, Pages 445-453. 

96. A. Gorban, B. Kaganovich, S. Filippov, A. Keiko, V. Shamansky, L Shirkalin, 
Thermodynamic Equilibria and Extrema: Analysis of Attainability Regions 
and Partial Equilibrium, Springer, Berlin, Heidelberg, New York, 2006 (in 
press). 

97. Ansumali, S., Karlin, LV., Kinetic Boundary condition for the lattice Boltz- 
mann method, Phys. Rev. E, 66 (2002), 026311. 

98. J.R. Higgins, Sampling Theory in Fourier and Signal Analysis: Foundations, 
Clarendon, Oxford, 1996. 

99. J.R. Higgins, R.L. Stens, Sampling Theory in Fourier and Signal Analysis: 
Advanced Topics, Clarendon, Oxford, 1999. 

100. J.G.M. Kuerten, B.J. Geurts, A.W. Vreman, M. Germano. Dynamic inverse 
modeling and its testing in large-eddy simulations of the mixing layer. Phys. 
Fluids, 11: 3778-3785, 1999. 

101. A.W. Vreman, The adjoint filter operator in large-eddy simulation of turbulent 
flow, Phys. Fluids, 16 (2004), 2012-2022 



60 Alexander N. Gorban 

102. B.J. Geurts, D.D. Holm, Nonlinear regularization for large-eddy simulation, 
Phys. Fluids, 15, 1 (2003), L13-L16. 

103. P. Moeleker, A. Leonard, Lagrangian methods for the tensor-diffusivity subgrid 
model, J. Comp. Phys., 167 (2001), 1-21. 

104. G. Berkooz, P. Holmes, J.L. Lumley, The proper orthogonal decomposition in 
the analysis of turbulent flows. Annual Rev. Fluid Mech., 25 (1993), 539-575. 

105. I.T. JoUiffe, Principal component analysis, Springer-Verlag, 1986. 

106. K. Kunisch, S. Volkwein, Galerkin Proper Orthogonal Decomposition Methods 
for a General Equation in Fluid Dynamics, SI AM J Numer. Anal. 40, 2 (2002), 
492-515. 

107. M. Marion, R. Temam, Nonlinear Galerkin methods, SIAM J. Numer. Anal, 
26 (1989), 1139-1157. 

108. A. Gorban, A. Zinovyev, Elastic Principal Graphs and Manifolds and their 
Practical Applications, Computing 75, 359379 (2005), 

109. G.D. Birkhoff, Dynamical systems, AMS Colloquium Publications, Providence, 
1927. Online: http://www.ams.org/online _bks/coll9/ 

110. B. Hasselblatt, A. Katok, (Eds.), Handbook of Dynamical Systems, Elsevier, 
2002. 

111. A. Katok, B. Hasselblat, Introduction to the Modern Theory of Dynamical 
Systems, Encyclopedia of Math, and its Applications, Vol. 54, Cambridge Uni- 
versity Press, 1995. 

112. J. Milnor, On the concept of attractor. Comm. Math. Phys. 99, (1985), 177-195 

113. P. Ashwin and J.R. Terry. On riddling and weak attractors. Physica D 142 
(2000), 87-100. 

114. D.V. Anosov, About one class of invariant sets of smooth dynamical systems. 
Proceedings of International conference on non-linear oscillation, V.2. Kiev, 
1970, 39-45. 

115. P. Walters, On the pseudoorbit tracing property and its relationship to stabil- 
ity, Lect. Notes Math. V. 668 (1978), 231-244. 

116. J.E. Franke, J.F. Selgrade, Hyperbolicity and chain recurrence, J. Different. 
Equat. 26, 1 (1977), 27-36. 

117. H. Easton, Chain transitivity and the domain of influence of an invariant set, 
Lect. Notes Math., V.668 (1978), p.95-102. 

118. Y. Sinai, Gibbs measures in ergodic theory, Russ. Math. Surveys 166 (1972), 
pp. 21-69. 

119. I.e. Malkin, On the stability under uniformly influencing perturbations, Prikl. 
Matem. Mech. 8, 3 (1944), 241-245. 

120. V.E. Germaidze, N.N. Krasovskii, On the stability under sustained perturba- 
tions, Pnkl. Matem. Mech. 21, 6 (1957), 769-775. 

121. I.e. Malkin, The motion stability theory. Moscow: Nauka, 1966. 

122. A. Strauss, A.J. Yorke, Identifying perturbations which preserved asymptotic 
stability, Proc. Amer. Math. Soc. 22, 2 (1969), 513-518. 

123. M. Gromov, Metric structures for Riemannian and non-Riemannian spaces. 
Progress in Mathematics, 152. Birkhauser Boston, Inc., Boston, MA, 1999. 



